2011-04-29 11:09:31,745 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:zookeeper.version=3.3.1-942149, built on 05/07/2010 17:14 GMT 2011-04-29 11:09:31,748 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:host.name=wl-50.cine.hmc.edu 2011-04-29 11:09:31,749 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.version=1.6.0_24 2011-04-29 11:09:31,749 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.vendor=Apple Inc. 2011-04-29 11:09:31,749 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home 2011-04-29 11:09:31,750 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.class.path=/Users/rmelick/hive/build/ql/test/classes:/Users/rmelick/hive/ql:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/conf:/Users/rmelick/hive/data/conf:/Users/rmelick/hive/conf:/Users/rmelick/hive/cli/lib/jline-0.9.94.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/hadoop-0.20.1-test.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-httpclient-3.0.1.jar:/Users/rmelick/hive/lib/derby.jar:/Users/rmelick/hive/testlibs/ant-contrib-1.0b3.jar:/Users/rmelick/hive/testlibs/junit-3.8.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-cli-1.2.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-codec-1.3.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-el-1.0.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-logging-1.0.4.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-logging-api-1.0.4.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-net-1.4.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/core-3.1.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/hsqldb-1.8.0.10.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jasper-compiler-5.5.12.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jasper-runtime-5.5.12.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jets3t-0.6.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jetty-6.1.14.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jetty-util-6.1.14.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/junit-3.8.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/kfs-0.2.2.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/log4j-1.2.15.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/oro-2.0.8.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/servlet-api-2.5-6.1.14.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/slf4j-api-1.4.3.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/slf4j-log4j12-1.4.3.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/xmlenc-0.52.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jsp-2.1/jsp-2.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jsp-2.1/jsp-api-2.1.jar:/Users/rmelick/hive/build/service/classes:/Users/rmelick/hive/build/common/classes:/Users/rmelick/hive/build/serde/classes:/Users/rmelick/hive/build/metastore/classes:/Users/rmelick/hive/build/ql/classes:/Users/rmelick/hive/build/cli/classes:/Users/rmelick/hive/build/shims/classes:/Users/rmelick/hive/build/hwi/classes:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/hadoop-0.20.1-core.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/hadoop-0.20.1-tools.jar:/Users/rmelick/hive/build/anttasks/hive-anttasks-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/cli/hive-cli-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/common/hive-common-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/contrib/hive-contrib-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/hbase-handler/hive-hbase-handler-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/hwi/hive-hwi-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/jdbc/hive-jdbc-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/metastore/hive-metastore-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/ql/hive-exec-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/serde/hive-serde-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/service/hive-service-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/shims/hive-shims-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/lib/asm-3.1.jar:/Users/rmelick/hive/lib/commons-codec-1.3.jar:/Users/rmelick/hive/lib/commons-collections-3.2.1.jar:/Users/rmelick/hive/lib/commons-lang-2.4.jar:/Users/rmelick/hive/lib/commons-logging-1.0.4.jar:/Users/rmelick/hive/lib/commons-logging-api-1.0.4.jar:/Users/rmelick/hive/lib/javaewah-0.2.jar:/Users/rmelick/hive/lib/json.jar:/Users/rmelick/hive/lib/log4j-1.2.15.jar:/Users/rmelick/hive/lib/thrift-0.5.0.jar:/Users/rmelick/hive/lib/thrift-fb303-0.5.0.jar:/Users/rmelick/hive/lib/velocity-1.5.jar:/Users/rmelick/hive/ql/lib/antlr-2.7.7.jar:/Users/rmelick/hive/ql/lib/antlr-3.0.1.jar:/Users/rmelick/hive/ql/lib/antlr-runtime-3.0.1.jar:/Users/rmelick/hive/ql/lib/stringtemplate-3.1b1.jar:/Users/rmelick/hive/build/ivy/lib/default/commons-cli-1.2.jar:/Users/rmelick/hive/build/ivy/lib/default/commons-dbcp-1.4.jar:/Users/rmelick/hive/build/ivy/lib/default/commons-pool-1.5.4.jar:/Users/rmelick/hive/build/ivy/lib/default/datanucleus-connectionpool-2.0.3.jar:/Users/rmelick/hive/build/ivy/lib/default/datanucleus-core-2.0.3.jar:/Users/rmelick/hive/build/ivy/lib/default/datanucleus-enhancer-2.0.3.jar:/Users/rmelick/hive/build/ivy/lib/default/datanucleus-rdbms-2.0.3.jar:/Users/rmelick/hive/build/ivy/lib/default/guava-r06.jar:/Users/rmelick/hive/build/ivy/lib/default/hbase-0.89.0-SNAPSHOT-tests.jar:/Users/rmelick/hive/build/ivy/lib/default/hbase-0.89.0-SNAPSHOT.jar:/Users/rmelick/hive/build/ivy/lib/default/jdo2-api-2.3-ec.jar:/Users/rmelick/hive/build/ivy/lib/default/log4j-1.2.16.jar:/Users/rmelick/hive/build/ivy/lib/default/slf4j-api-1.6.1.jar:/Users/rmelick/hive/build/ivy/lib/default/slf4j-log4j12-1.6.1.jar:/Users/rmelick/hive/build/ivy/lib/default/zookeeper-3.3.1.jar:/usr/share/java/ant-1.8.2/lib/ant-launcher.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-junit4.jar 2011-04-29 11:09:31,751 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java 2011-04-29 11:09:31,752 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.io.tmpdir=/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/ 2011-04-29 11:09:31,752 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.compiler= 2011-04-29 11:09:31,752 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:os.name=Mac OS X 2011-04-29 11:09:31,753 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:os.arch=x86_64 2011-04-29 11:09:31,753 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:os.version=10.6.7 2011-04-29 11:09:31,753 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:user.name=rmelick 2011-04-29 11:09:31,754 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:user.home=/Users/rmelick 2011-04-29 11:09:31,754 INFO server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:user.dir=/Users/rmelick/hive/ql 2011-04-29 11:09:31,791 INFO server.ZooKeeperServer (ZooKeeperServer.java:(151)) - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /Users/rmelick/hive/ql/../build/ql/tmp/zookeeper/zookeeper/version-2 snapdir /Users/rmelick/hive/ql/../build/ql/tmp/zookeeper/zookeeper/version-2 2011-04-29 11:09:31,846 INFO server.NIOServerCnxn (NIOServerCnxn.java:(143)) - binding to port 0.0.0.0/0.0.0.0:21818 2011-04-29 11:09:31,856 INFO persistence.FileTxnSnapLog (FileTxnSnapLog.java:save(208)) - Snapshotting: 0 2011-04-29 11:09:31,967 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56304 2011-04-29 11:09:31,971 INFO server.NIOServerCnxn (NIOServerCnxn.java:checkFourLetterWord(1236)) - Processing stat command from /127.0.0.1:56304 2011-04-29 11:09:31,975 INFO server.NIOServerCnxn (NIOServerCnxn.java:commandRun(1152)) - Stat command output 2011-04-29 11:09:31,976 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56304 (no session established for client) 2011-04-29 11:09:31,977 INFO zookeeper.MiniZooKeeperCluster (MiniZooKeeperCluster.java:startup(125)) - Started MiniZK Server on client port: 21818 2011-04-29 11:09:31,986 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:zookeeper.version=3.3.1-942149, built on 05/07/2010 17:14 GMT 2011-04-29 11:09:31,987 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:host.name=wl-50.cine.hmc.edu 2011-04-29 11:09:31,987 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:java.version=1.6.0_24 2011-04-29 11:09:31,987 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:java.vendor=Apple Inc. 2011-04-29 11:09:31,987 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home 2011-04-29 11:09:31,988 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:java.class.path=/Users/rmelick/hive/build/ql/test/classes:/Users/rmelick/hive/ql:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/conf:/Users/rmelick/hive/data/conf:/Users/rmelick/hive/conf:/Users/rmelick/hive/cli/lib/jline-0.9.94.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/hadoop-0.20.1-test.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-httpclient-3.0.1.jar:/Users/rmelick/hive/lib/derby.jar:/Users/rmelick/hive/testlibs/ant-contrib-1.0b3.jar:/Users/rmelick/hive/testlibs/junit-3.8.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-cli-1.2.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-codec-1.3.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-el-1.0.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-logging-1.0.4.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-logging-api-1.0.4.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/commons-net-1.4.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/core-3.1.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/hsqldb-1.8.0.10.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jasper-compiler-5.5.12.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jasper-runtime-5.5.12.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jets3t-0.6.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jetty-6.1.14.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jetty-util-6.1.14.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/junit-3.8.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/kfs-0.2.2.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/log4j-1.2.15.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/oro-2.0.8.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/servlet-api-2.5-6.1.14.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/slf4j-api-1.4.3.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/slf4j-log4j12-1.4.3.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/xmlenc-0.52.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jsp-2.1/jsp-2.1.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/lib/jsp-2.1/jsp-api-2.1.jar:/Users/rmelick/hive/build/service/classes:/Users/rmelick/hive/build/common/classes:/Users/rmelick/hive/build/serde/classes:/Users/rmelick/hive/build/metastore/classes:/Users/rmelick/hive/build/ql/classes:/Users/rmelick/hive/build/cli/classes:/Users/rmelick/hive/build/shims/classes:/Users/rmelick/hive/build/hwi/classes:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/hadoop-0.20.1-core.jar:/Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/hadoop-0.20.1-tools.jar:/Users/rmelick/hive/build/anttasks/hive-anttasks-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/cli/hive-cli-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/common/hive-common-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/contrib/hive-contrib-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/hbase-handler/hive-hbase-handler-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/hwi/hive-hwi-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/jdbc/hive-jdbc-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/metastore/hive-metastore-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/ql/hive-exec-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/serde/hive-serde-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/service/hive-service-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/build/shims/hive-shims-0.8.0-SNAPSHOT.jar:/Users/rmelick/hive/lib/asm-3.1.jar:/Users/rmelick/hive/lib/commons-codec-1.3.jar:/Users/rmelick/hive/lib/commons-collections-3.2.1.jar:/Users/rmelick/hive/lib/commons-lang-2.4.jar:/Users/rmelick/hive/lib/commons-logging-1.0.4.jar:/Users/rmelick/hive/lib/commons-logging-api-1.0.4.jar:/Users/rmelick/hive/lib/javaewah-0.2.jar:/Users/rmelick/hive/lib/json.jar:/Users/rmelick/hive/lib/log4j-1.2.15.jar:/Users/rmelick/hive/lib/thrift-0.5.0.jar:/Users/rmelick/hive/lib/thrift-fb303-0.5.0.jar:/Users/rmelick/hive/lib/velocity-1.5.jar:/Users/rmelick/hive/ql/lib/antlr-2.7.7.jar:/Users/rmelick/hive/ql/lib/antlr-3.0.1.jar:/Users/rmelick/hive/ql/lib/antlr-runtime-3.0.1.jar:/Users/rmelick/hive/ql/lib/stringtemplate-3.1b1.jar:/Users/rmelick/hive/build/ivy/lib/default/commons-cli-1.2.jar:/Users/rmelick/hive/build/ivy/lib/default/commons-dbcp-1.4.jar:/Users/rmelick/hive/build/ivy/lib/default/commons-pool-1.5.4.jar:/Users/rmelick/hive/build/ivy/lib/default/datanucleus-connectionpool-2.0.3.jar:/Users/rmelick/hive/build/ivy/lib/default/datanucleus-core-2.0.3.jar:/Users/rmelick/hive/build/ivy/lib/default/datanucleus-enhancer-2.0.3.jar:/Users/rmelick/hive/build/ivy/lib/default/datanucleus-rdbms-2.0.3.jar:/Users/rmelick/hive/build/ivy/lib/default/guava-r06.jar:/Users/rmelick/hive/build/ivy/lib/default/hbase-0.89.0-SNAPSHOT-tests.jar:/Users/rmelick/hive/build/ivy/lib/default/hbase-0.89.0-SNAPSHOT.jar:/Users/rmelick/hive/build/ivy/lib/default/jdo2-api-2.3-ec.jar:/Users/rmelick/hive/build/ivy/lib/default/log4j-1.2.16.jar:/Users/rmelick/hive/build/ivy/lib/default/slf4j-api-1.6.1.jar:/Users/rmelick/hive/build/ivy/lib/default/slf4j-log4j12-1.6.1.jar:/Users/rmelick/hive/build/ivy/lib/default/zookeeper-3.3.1.jar:/usr/share/java/ant-1.8.2/lib/ant-launcher.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-junit4.jar 2011-04-29 11:09:31,989 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java 2011-04-29 11:09:31,989 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:java.io.tmpdir=/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/ 2011-04-29 11:09:31,989 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:java.compiler= 2011-04-29 11:09:31,989 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:os.name=Mac OS X 2011-04-29 11:09:31,990 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:os.arch=x86_64 2011-04-29 11:09:31,990 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:os.version=10.6.7 2011-04-29 11:09:31,990 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:user.name=rmelick 2011-04-29 11:09:31,990 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:user.home=/Users/rmelick 2011-04-29 11:09:31,991 INFO zookeeper.ZooKeeper (Environment.java:logEnv(97)) - Client environment:user.dir=/Users/rmelick/hive/ql 2011-04-29 11:09:31,992 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=null 2011-04-29 11:09:31,996 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:(96)) - zookeeper.disableAutoWatchReset is false 2011-04-29 11:09:32,011 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:32,013 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:32,015 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:32,015 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56305 2011-04-29 11:09:32,018 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56305 client's lastZxid is 0x0 2011-04-29 11:09:32,018 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56305 2011-04-29 11:09:32,030 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0000 type:createSession cxid:0x0 zxid:0x1 txntype:-10 reqpath:n/a 2011-04-29 11:09:32,046 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0000 type:createSession cxid:0x0 zxid:0x1 txntype:-10 reqpath:n/a 2011-04-29 11:09:32,057 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0000 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56305 2011-04-29 11:09:32,057 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb0000, negotiated timeout = 40000 2011-04-29 11:09:32,061 ERROR zookeeper.ClientCnxn (ClientCnxn.java:run(490)) - Error while calling watcher java.lang.NullPointerException at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:488) 2011-04-29 11:09:32,066 INFO exec.HiveHistory (SessionState.java:printInfo(365)) - Hive history file=/Users/rmelick/hive/build/ql/tmp/hive_job_log_rmelick_201104291109_319704350.txt 2011-04-29 11:09:32,310 DEBUG security.UserGroupInformation (UnixUserGroupInformation.java:login(301)) - Unix Login: rmelick,staff,com.apple.sharepoint.group.1,com.apple.sharepoint.group.3,_developer,_lpoperator,_lpadmin,_appserveradm,admin,_appserverusr,localaccounts,everyone,com.apple.access_ssh,com.apple.access_screensharing,com.apple.sharepoint.group.2,com.apple.sharepoint.group.4 2011-04-29 11:09:32,936 INFO metastore.HiveMetaStore (HiveMetaStore.java:getMS(348)) - 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 2011-04-29 11:09:32,958 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.cache.level2.type value null from jpox.properties with SOFT 2011-04-29 11:09:32,958 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.plugin.pluginRegistryBundleCheck value null from jpox.properties with LOG 2011-04-29 11:09:32,958 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding javax.jdo.option.ConnectionURL value null from jpox.properties with jdbc:derby:;databaseName=../build/test/junit_metastore_db;create=true 2011-04-29 11:09:32,959 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.autoStartMechanismMode value null from jpox.properties with checked 2011-04-29 11:09:32,959 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.validateConstraints value null from jpox.properties with false 2011-04-29 11:09:32,959 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.autoCreateSchema value null from jpox.properties with true 2011-04-29 11:09:32,960 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.cache.level2 value null from jpox.properties with false 2011-04-29 11:09:32,960 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding javax.jdo.option.ConnectionUserName value null from jpox.properties with APP 2011-04-29 11:09:32,960 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding javax.jdo.option.DetachAllOnCommit value null from jpox.properties with true 2011-04-29 11:09:32,961 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.connectionPoolingType value null from jpox.properties with DBCP 2011-04-29 11:09:32,961 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.storeManagerType value null from jpox.properties with rdbms 2011-04-29 11:09:32,962 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding javax.jdo.option.ConnectionDriverName value null from jpox.properties with org.apache.derby.jdbc.EmbeddedDriver 2011-04-29 11:09:32,962 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.transactionIsolation value null from jpox.properties with read-committed 2011-04-29 11:09:32,962 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.validateColumns value null from jpox.properties with false 2011-04-29 11:09:32,963 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding javax.jdo.option.NonTransactionalRead value null from jpox.properties with true 2011-04-29 11:09:32,963 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.validateTables value null from jpox.properties with false 2011-04-29 11:09:32,963 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding javax.jdo.PersistenceManagerFactoryClass value null from jpox.properties with org.datanucleus.jdo.JDOPersistenceManagerFactory 2011-04-29 11:09:32,964 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding javax.jdo.option.Multithreaded value null from jpox.properties with true 2011-04-29 11:09:32,964 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(216)) - Overriding datanucleus.identifierFactory value null from jpox.properties with datanucleus 2011-04-29 11:09:32,964 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.autoStartMechanismMode = checked 2011-04-29 11:09:32,965 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - javax.jdo.option.Multithreaded = true 2011-04-29 11:09:32,965 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.identifierFactory = datanucleus 2011-04-29 11:09:32,965 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.transactionIsolation = read-committed 2011-04-29 11:09:32,966 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.validateTables = false 2011-04-29 11:09:32,966 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - javax.jdo.option.ConnectionURL = jdbc:derby:;databaseName=../build/test/junit_metastore_db;create=true 2011-04-29 11:09:32,966 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - javax.jdo.option.DetachAllOnCommit = true 2011-04-29 11:09:32,967 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - javax.jdo.option.NonTransactionalRead = true 2011-04-29 11:09:32,967 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.validateConstraints = false 2011-04-29 11:09:32,967 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - javax.jdo.option.ConnectionDriverName = org.apache.derby.jdbc.EmbeddedDriver 2011-04-29 11:09:32,968 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - javax.jdo.option.ConnectionUserName = APP 2011-04-29 11:09:32,968 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.validateColumns = false 2011-04-29 11:09:32,968 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.cache.level2 = false 2011-04-29 11:09:32,969 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.plugin.pluginRegistryBundleCheck = LOG 2011-04-29 11:09:32,969 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.cache.level2.type = SOFT 2011-04-29 11:09:32,969 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - javax.jdo.PersistenceManagerFactoryClass = org.datanucleus.jdo.JDOPersistenceManagerFactory 2011-04-29 11:09:32,970 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.autoCreateSchema = true 2011-04-29 11:09:32,970 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.storeManagerType = rdbms 2011-04-29 11:09:32,970 DEBUG metastore.ObjectStore (ObjectStore.java:getDataSourceProps(225)) - datanucleus.connectionPoolingType = DBCP 2011-04-29 11:09:32,971 INFO metastore.ObjectStore (ObjectStore.java:initialize(194)) - ObjectStore, initialize called 2011-04-29 11:09:33,322 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved. 2011-04-29 11:09:33,322 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be resolved. 2011-04-29 11:09:33,323 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved. 2011-04-29 11:09:33,323 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.core.runtime" but it cannot be resolved. 2011-04-29 11:09:33,324 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved. 2011-04-29 11:09:33,324 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires "org.eclipse.text" but it cannot be resolved. 2011-04-29 11:09:35,953 INFO metastore.ObjectStore (ObjectStore.java:getPMF(239)) - Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" 2011-04-29 11:09:36,019 INFO metastore.ObjectStore (ObjectStore.java:setConf(177)) - Initialized ObjectStore 2011-04-29 11:09:37,473 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src 2011-04-29 11:09:38,450 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src1 2011-04-29 11:09:38,453 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_json 2011-04-29 11:09:38,456 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_thrift 2011-04-29 11:09:38,459 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_sequencefile 2011-04-29 11:09:38,462 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:38,465 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:09:38,468 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:38,471 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest1 2011-04-29 11:09:38,477 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest2 2011-04-29 11:09:38,480 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest3 2011-04-29 11:09:38,483 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest4 2011-04-29 11:09:38,485 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest4_sequencefile 2011-04-29 11:09:38,488 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest_j1 2011-04-29 11:09:38,490 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest_j2 2011-04-29 11:09:38,493 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest_g1 2011-04-29 11:09:38,496 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest_g2 2011-04-29 11:09:38,499 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=fetchtask_ioexception 2011-04-29 11:09:38,767 INFO exec.HiveHistory (SessionState.java:printInfo(365)) - Hive history file=/Users/rmelick/hive/build/ql/tmp/hive_job_log_rmelick_201104291109_1428923925.txt 2011-04-29 11:09:38,914 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:38,937 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@1997f158] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:38,940 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=srcpart 2011-04-29 11:09:38,944 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcpart 2011-04-29 11:09:39,225 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:39,244 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='11') 2011-04-29 11:09:39,247 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='11') 2011-04-29 11:09:39,396 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:39,408 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:39,409 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:39,513 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:39,514 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@a0002df] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:39,514 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,11] 2011-04-29 11:09:39,855 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,11] 2011-04-29 11:09:39,915 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:39,916 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:40,043 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:40,043 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:40,050 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@1a3a2a52 2011-04-29 11:09:40,057 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:40,060 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:40,060 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56306 2011-04-29 11:09:40,060 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:40,061 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56306 client's lastZxid is 0x0 2011-04-29 11:09:40,061 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56306 2011-04-29 11:09:40,077 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0001 type:createSession cxid:0x0 zxid:0x2 txntype:-10 reqpath:n/a 2011-04-29 11:09:40,077 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0001 type:createSession cxid:0x0 zxid:0x2 txntype:-10 reqpath:n/a 2011-04-29 11:09:40,080 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0001 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56306 2011-04-29 11:09:40,080 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb0001, negotiated timeout = 40000 2011-04-29 11:09:40,094 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0001 type:create cxid:0x1 zxid:0x3 txntype:1 reqpath:n/a 2011-04-29 11:09:40,094 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0001 type:create cxid:0x1 zxid:0x3 txntype:1 reqpath:n/a 2011-04-29 11:09:40,098 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0001, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,3,0 request:: '/hive_zookeeper_namespace,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace 2011-04-29 11:09:40,098 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:40,102 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0001 2011-04-29 11:09:40,102 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0001 2011-04-29 11:09:40,103 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0001 2011-04-29 11:09:40,104 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0001 type:closeSession cxid:0x2 zxid:0x4 txntype:-11 reqpath:n/a 2011-04-29 11:09:40,104 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0001 type:closeSession cxid:0x2 zxid:0x4 txntype:-11 reqpath:n/a 2011-04-29 11:09:40,106 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56306 which had sessionid 0x12fa2738adb0001 2011-04-29 11:09:40,107 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0001, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,4,0 request:: null response:: null 2011-04-29 11:09:40,108 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0001 : Unable to read additional data from server sessionid 0x12fa2738adb0001, likely server has closed socket 2011-04-29 11:09:40,108 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:40,108 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0001 2011-04-29 11:09:40,109 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0001 closed 2011-04-29 11:09:40,109 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@334362d9 2011-04-29 11:09:40,110 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:40,111 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56307 2011-04-29 11:09:40,111 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:40,111 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:40,117 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56307 client's lastZxid is 0x0 2011-04-29 11:09:40,117 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56307 2011-04-29 11:09:40,118 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:createSession cxid:0x0 zxid:0x5 txntype:-10 reqpath:n/a 2011-04-29 11:09:40,118 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:createSession cxid:0x0 zxid:0x5 txntype:-10 reqpath:n/a 2011-04-29 11:09:40,119 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0002 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56307 2011-04-29 11:09:40,119 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb0002, negotiated timeout = 40000 2011-04-29 11:09:40,120 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:create cxid:0x1 zxid:0x6 txntype:1 reqpath:n/a 2011-04-29 11:09:40,121 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:create cxid:0x1 zxid:0x6 txntype:1 reqpath:n/a 2011-04-29 11:09:40,122 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,6,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:40,123 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:create cxid:0x2 zxid:0x7 txntype:1 reqpath:n/a 2011-04-29 11:09:40,124 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:create cxid:0x2 zxid:0x7 txntype:1 reqpath:n/a 2011-04-29 11:09:40,125 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,7,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f62303734373238622d643933352d343237612d393337392d6132613164333739653934353a313330343130303538303130303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:40,128 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:40,128 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:40,129 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,7,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:40,131 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:create cxid:0x4 zxid:0x8 txntype:1 reqpath:n/a 2011-04-29 11:09:40,131 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:create cxid:0x4 zxid:0x8 txntype:1 reqpath:n/a 2011-04-29 11:09:40,132 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,8,0 request:: '/hive_zookeeper_namespace/default/srcpart,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:40,134 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:create cxid:0x5 zxid:0x9 txntype:1 reqpath:n/a 2011-04-29 11:09:40,134 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:create cxid:0x5 zxid:0x9 txntype:1 reqpath:n/a 2011-04-29 11:09:40,135 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,9,0 request:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f62303734373238622d643933352d343237612d393337392d6132613164333739653934353a313330343130303538303130303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:40,136 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:40,136 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:40,137 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,9,0 request:: '/hive_zookeeper_namespace/default/srcpart,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:40,137 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:40,138 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:40,138 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='11') 2011-04-29 11:09:40,154 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:40,154 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='11') 2011-04-29 11:09:40,155 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:40,155 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcpart 2011-04-29 11:09:40,155 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:40,155 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:40,156 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:40,160 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/kv1.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-39_246_6021812406278320224/-ext-10000 2011-04-29 11:09:40,200 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:40,445 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcpart partition (ds=2008-04-08, hr=11) from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-39_246_6021812406278320224/-ext-10000 2011-04-29 11:09:40,445 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:40,480 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:40,481 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@5b080f38] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:40,742 INFO exec.MoveTask (MoveTask.java:execute(203)) - Partition is: {ds=2008-04-08, hr=11} 2011-04-29 11:09:40,743 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:40,770 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:40,771 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@77be91c8] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:40,771 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,11] 2011-04-29 11:09:40,906 DEBUG metadata.Hive (Hive.java:replaceFiles(1944)) - Renaming:pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-39_246_6021812406278320224/-ext-10000 to pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcpart/ds=2008-04-08/hr=11,Status:true 2011-04-29 11:09:40,907 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,11] 2011-04-29 11:09:40,923 DEBUG metadata.Hive (Hive.java:getPartition(1365)) - creating partition for table srcpart with partition spec : {ds=2008-04-08, hr=11} 2011-04-29 11:09:40,924 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: append_partition : db=default tbl=srcpart[2008-04-08,11] 2011-04-29 11:09:40,924 DEBUG metastore.HiveMetaStore (HiveMetaStore.java:append_partition(1189)) - 2008-04-08 2011-04-29 11:09:40,924 DEBUG metastore.HiveMetaStore (HiveMetaStore.java:append_partition(1189)) - 11 2011-04-29 11:09:41,108 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,11] 2011-04-29 11:09:41,218 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:41,219 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='11') 2011-04-29 11:09:41,219 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:41,307 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcpart 2011-04-29 11:09:41,326 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcpart@ds=2008-04-08/hr=11 2011-04-29 11:09:41,327 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:41,328 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:41,339 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:41,339 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:41,343 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:delete cxid:0x7 zxid:0xa txntype:2 reqpath:n/a 2011-04-29 11:09:41,344 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:delete cxid:0x7 zxid:0xa txntype:2 reqpath:n/a 2011-04-29 11:09:41,349 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,10,0 request:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:41,351 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:41,360 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:41,361 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,10,0 request:: '/hive_zookeeper_namespace/default/srcpart,F response:: v{} 2011-04-29 11:09:41,372 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:delete cxid:0x9 zxid:0xb txntype:2 reqpath:n/a 2011-04-29 11:09:41,372 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:delete cxid:0x9 zxid:0xb txntype:2 reqpath:n/a 2011-04-29 11:09:41,373 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,11,0 request:: '/hive_zookeeper_namespace/default/srcpart,-1 response:: null 2011-04-29 11:09:41,453 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:delete cxid:0xa zxid:0xc txntype:2 reqpath:n/a 2011-04-29 11:09:41,454 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:delete cxid:0xa zxid:0xc txntype:2 reqpath:n/a 2011-04-29 11:09:41,458 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,12,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:41,463 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:41,463 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:41,464 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,12,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:41,465 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:delete cxid:0xc zxid:0xd txntype:2 reqpath:n/a 2011-04-29 11:09:41,466 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:delete cxid:0xc zxid:0xd txntype:2 reqpath:n/a 2011-04-29 11:09:41,467 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,13,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:41,468 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:41,472 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:41,473 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='12') 2011-04-29 11:09:41,474 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='12') 2011-04-29 11:09:41,475 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:41,475 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:41,476 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:41,505 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:41,506 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@17d9d565] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:41,506 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,12] 2011-04-29 11:09:41,571 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,12] 2011-04-29 11:09:41,601 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:41,602 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:41,603 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:41,603 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:41,603 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:41,604 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0002 2011-04-29 11:09:41,604 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0002 2011-04-29 11:09:41,606 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0002 2011-04-29 11:09:41,607 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0002 type:closeSession cxid:0xd zxid:0xe txntype:-11 reqpath:n/a 2011-04-29 11:09:41,607 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0002 type:closeSession cxid:0xd zxid:0xe txntype:-11 reqpath:n/a 2011-04-29 11:09:41,619 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0002, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,14,0 request:: null response:: null 2011-04-29 11:09:41,619 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56307 which had sessionid 0x12fa2738adb0002 2011-04-29 11:09:41,619 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0002 : Unable to read additional data from server sessionid 0x12fa2738adb0002, likely server has closed socket 2011-04-29 11:09:41,619 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:41,619 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0002 2011-04-29 11:09:41,620 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0002 closed 2011-04-29 11:09:41,627 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@43c8308 2011-04-29 11:09:41,628 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:09:41,629 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56308 2011-04-29 11:09:41,634 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:09:41,634 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:09:41,635 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56308 client's lastZxid is 0x0 2011-04-29 11:09:41,635 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56308 2011-04-29 11:09:41,636 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:createSession cxid:0x0 zxid:0xf txntype:-10 reqpath:n/a 2011-04-29 11:09:41,636 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:createSession cxid:0x0 zxid:0xf txntype:-10 reqpath:n/a 2011-04-29 11:09:41,637 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0003 with negotiated timeout 40000 for client /127.0.0.1:56308 2011-04-29 11:09:41,638 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb0003, negotiated timeout = 40000 2011-04-29 11:09:41,639 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:create cxid:0x1 zxid:0x10 txntype:1 reqpath:n/a 2011-04-29 11:09:41,639 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:create cxid:0x1 zxid:0x10 txntype:1 reqpath:n/a 2011-04-29 11:09:41,641 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,16,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:41,643 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:create cxid:0x2 zxid:0x11 txntype:1 reqpath:n/a 2011-04-29 11:09:41,643 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:create cxid:0x2 zxid:0x11 txntype:1 reqpath:n/a 2011-04-29 11:09:41,645 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,17,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f33386662346136662d363633332d346136362d383936362d6463383464316335653935343a313330343130303538313630343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:41,646 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:41,646 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:41,647 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,17,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:41,654 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:create cxid:0x4 zxid:0x12 txntype:1 reqpath:n/a 2011-04-29 11:09:41,655 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:create cxid:0x4 zxid:0x12 txntype:1 reqpath:n/a 2011-04-29 11:09:41,656 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,18,0 request:: '/hive_zookeeper_namespace/default/srcpart,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:41,658 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:create cxid:0x5 zxid:0x13 txntype:1 reqpath:n/a 2011-04-29 11:09:41,658 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:create cxid:0x5 zxid:0x13 txntype:1 reqpath:n/a 2011-04-29 11:09:41,660 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,19,0 request:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f33386662346136662d363633332d346136362d383936362d6463383464316335653935343a313330343130303538313630343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:41,660 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:41,661 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:41,662 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,19,0 request:: '/hive_zookeeper_namespace/default/srcpart,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:41,662 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:41,662 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:41,663 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='12') 2011-04-29 11:09:41,664 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:41,664 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='12') 2011-04-29 11:09:41,665 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:41,665 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcpart 2011-04-29 11:09:41,665 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:41,666 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:41,666 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:41,667 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/kv1.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-41_473_1058112431638405535/-ext-10000 2011-04-29 11:09:41,712 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:41,841 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcpart partition (ds=2008-04-08, hr=12) from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-41_473_1058112431638405535/-ext-10000 2011-04-29 11:09:41,841 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:41,863 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:41,864 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@5fbd8c6e] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:42,015 INFO exec.MoveTask (MoveTask.java:execute(203)) - Partition is: {ds=2008-04-08, hr=12} 2011-04-29 11:09:42,016 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:42,039 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:42,040 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@1cc7e90] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:42,040 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,12] 2011-04-29 11:09:42,162 DEBUG metadata.Hive (Hive.java:replaceFiles(1944)) - Renaming:pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-41_473_1058112431638405535/-ext-10000 to pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcpart/ds=2008-04-08/hr=12,Status:true 2011-04-29 11:09:42,163 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,12] 2011-04-29 11:09:42,184 DEBUG metadata.Hive (Hive.java:getPartition(1365)) - creating partition for table srcpart with partition spec : {ds=2008-04-08, hr=12} 2011-04-29 11:09:42,184 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: append_partition : db=default tbl=srcpart[2008-04-08,12] 2011-04-29 11:09:42,185 DEBUG metastore.HiveMetaStore (HiveMetaStore.java:append_partition(1189)) - 2008-04-08 2011-04-29 11:09:42,185 DEBUG metastore.HiveMetaStore (HiveMetaStore.java:append_partition(1189)) - 12 2011-04-29 11:09:42,269 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-08,12] 2011-04-29 11:09:42,295 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:42,296 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-08',hr='12') 2011-04-29 11:09:42,296 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:42,296 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcpart 2011-04-29 11:09:42,297 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcpart@ds=2008-04-08/hr=12 2011-04-29 11:09:42,297 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:42,297 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:42,298 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:42,298 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:42,300 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:delete cxid:0x7 zxid:0x14 txntype:2 reqpath:n/a 2011-04-29 11:09:42,301 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:delete cxid:0x7 zxid:0x14 txntype:2 reqpath:n/a 2011-04-29 11:09:42,301 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,20,0 request:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:42,302 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:42,302 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:42,303 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,20,0 request:: '/hive_zookeeper_namespace/default/srcpart,F response:: v{} 2011-04-29 11:09:42,305 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:delete cxid:0x9 zxid:0x15 txntype:2 reqpath:n/a 2011-04-29 11:09:42,305 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:delete cxid:0x9 zxid:0x15 txntype:2 reqpath:n/a 2011-04-29 11:09:42,306 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,21,0 request:: '/hive_zookeeper_namespace/default/srcpart,-1 response:: null 2011-04-29 11:09:42,307 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:delete cxid:0xa zxid:0x16 txntype:2 reqpath:n/a 2011-04-29 11:09:42,307 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:delete cxid:0xa zxid:0x16 txntype:2 reqpath:n/a 2011-04-29 11:09:42,308 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,22,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:42,309 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:42,309 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:42,310 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,22,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:42,311 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:delete cxid:0xc zxid:0x17 txntype:2 reqpath:n/a 2011-04-29 11:09:42,312 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:delete cxid:0xc zxid:0x17 txntype:2 reqpath:n/a 2011-04-29 11:09:42,313 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,23,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:42,313 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:42,314 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:42,315 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='11') 2011-04-29 11:09:42,316 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='11') 2011-04-29 11:09:42,317 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:42,318 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:42,318 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:42,394 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:42,395 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@19166179] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:42,396 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,11] 2011-04-29 11:09:42,451 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,11] 2011-04-29 11:09:42,470 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:42,471 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:42,472 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:42,472 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:42,472 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:42,473 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0003 2011-04-29 11:09:42,473 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0003 2011-04-29 11:09:42,481 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0003 2011-04-29 11:09:42,483 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0003 type:closeSession cxid:0xd zxid:0x18 txntype:-11 reqpath:n/a 2011-04-29 11:09:42,484 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0003 type:closeSession cxid:0xd zxid:0x18 txntype:-11 reqpath:n/a 2011-04-29 11:09:42,485 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0003, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,24,0 request:: null response:: null 2011-04-29 11:09:42,485 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0003 2011-04-29 11:09:42,486 WARN server.NIOServerCnxn (NIOServerCnxn.java:doIO(633)) - EndOfStreamException: Unable to read additional data from client sessionid 0x12fa2738adb0003, likely client has closed socket 2011-04-29 11:09:42,487 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56308 which had sessionid 0x12fa2738adb0003 2011-04-29 11:09:42,487 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1458)) - ignoring exception during input shutdown java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.server.NIOServerCnxn.closeSock(NIOServerCnxn.java:1454) at org.apache.zookeeper.server.NIOServerCnxn.close(NIOServerCnxn.java:1411) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:636) at org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:261) 2011-04-29 11:09:42,491 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0003 closed 2011-04-29 11:09:42,492 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@561ba49d 2011-04-29 11:09:42,492 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:09:42,493 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /0:0:0:0:0:0:0:1%0:56309 2011-04-29 11:09:42,494 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/0:0:0:0:0:0:0:1:21818, initiating session 2011-04-29 11:09:42,495 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:09:42,495 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /0:0:0:0:0:0:0:1%0:56309 client's lastZxid is 0x0 2011-04-29 11:09:42,495 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /0:0:0:0:0:0:0:1%0:56309 2011-04-29 11:09:42,497 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:createSession cxid:0x0 zxid:0x19 txntype:-10 reqpath:n/a 2011-04-29 11:09:42,498 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:createSession cxid:0x0 zxid:0x19 txntype:-10 reqpath:n/a 2011-04-29 11:09:42,499 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0004 with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1%0:56309 2011-04-29 11:09:42,499 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21818, sessionid = 0x12fa2738adb0004, negotiated timeout = 40000 2011-04-29 11:09:42,501 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:create cxid:0x1 zxid:0x1a txntype:1 reqpath:n/a 2011-04-29 11:09:42,501 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:create cxid:0x1 zxid:0x1a txntype:1 reqpath:n/a 2011-04-29 11:09:42,508 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,26,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:42,519 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:create cxid:0x2 zxid:0x1b txntype:1 reqpath:n/a 2011-04-29 11:09:42,528 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:create cxid:0x2 zxid:0x1b txntype:1 reqpath:n/a 2011-04-29 11:09:42,529 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,27,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f33373934643834652d306532372d343566322d396161662d3761363166653665656261333a313330343130303538323437333a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:42,549 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:42,549 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:42,551 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,27,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:42,558 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:create cxid:0x4 zxid:0x1c txntype:1 reqpath:n/a 2011-04-29 11:09:42,558 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:create cxid:0x4 zxid:0x1c txntype:1 reqpath:n/a 2011-04-29 11:09:42,559 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,28,0 request:: '/hive_zookeeper_namespace/default/srcpart,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:42,565 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:create cxid:0x5 zxid:0x1d txntype:1 reqpath:n/a 2011-04-29 11:09:42,566 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:create cxid:0x5 zxid:0x1d txntype:1 reqpath:n/a 2011-04-29 11:09:42,567 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,29,0 request:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f33373934643834652d306532372d343566322d396161662d3761363166653665656261333a313330343130303538323437333a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:42,569 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:42,569 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:42,570 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,29,0 request:: '/hive_zookeeper_namespace/default/srcpart,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:42,572 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:42,572 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:42,572 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='11') 2011-04-29 11:09:42,573 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:42,574 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='11') 2011-04-29 11:09:42,574 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:42,574 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcpart 2011-04-29 11:09:42,574 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:42,575 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:42,575 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:42,576 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/kv1.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-42_315_8429913975947347872/-ext-10000 2011-04-29 11:09:42,634 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:42,769 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcpart partition (ds=2008-04-09, hr=11) from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-42_315_8429913975947347872/-ext-10000 2011-04-29 11:09:42,770 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:42,819 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:42,820 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@6a9a4f8e] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:42,982 INFO exec.MoveTask (MoveTask.java:execute(203)) - Partition is: {ds=2008-04-09, hr=11} 2011-04-29 11:09:42,983 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:43,012 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:43,109 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@1aa3c177] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:43,109 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,11] 2011-04-29 11:09:43,241 DEBUG metadata.Hive (Hive.java:replaceFiles(1944)) - Renaming:pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-42_315_8429913975947347872/-ext-10000 to pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcpart/ds=2008-04-09/hr=11,Status:true 2011-04-29 11:09:43,242 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,11] 2011-04-29 11:09:43,257 DEBUG metadata.Hive (Hive.java:getPartition(1365)) - creating partition for table srcpart with partition spec : {ds=2008-04-09, hr=11} 2011-04-29 11:09:43,258 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: append_partition : db=default tbl=srcpart[2008-04-09,11] 2011-04-29 11:09:43,258 DEBUG metastore.HiveMetaStore (HiveMetaStore.java:append_partition(1189)) - 2008-04-09 2011-04-29 11:09:43,258 DEBUG metastore.HiveMetaStore (HiveMetaStore.java:append_partition(1189)) - 11 2011-04-29 11:09:43,349 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,11] 2011-04-29 11:09:43,377 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:43,377 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='11') 2011-04-29 11:09:43,378 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:43,378 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcpart 2011-04-29 11:09:43,378 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcpart@ds=2008-04-09/hr=11 2011-04-29 11:09:43,378 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:43,379 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:43,379 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:43,379 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:43,381 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:delete cxid:0x7 zxid:0x1e txntype:2 reqpath:n/a 2011-04-29 11:09:43,382 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:delete cxid:0x7 zxid:0x1e txntype:2 reqpath:n/a 2011-04-29 11:09:43,382 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,30,0 request:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:43,383 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:43,383 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:43,384 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,30,0 request:: '/hive_zookeeper_namespace/default/srcpart,F response:: v{} 2011-04-29 11:09:43,385 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:delete cxid:0x9 zxid:0x1f txntype:2 reqpath:n/a 2011-04-29 11:09:43,385 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:delete cxid:0x9 zxid:0x1f txntype:2 reqpath:n/a 2011-04-29 11:09:43,386 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,31,0 request:: '/hive_zookeeper_namespace/default/srcpart,-1 response:: null 2011-04-29 11:09:43,387 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:delete cxid:0xa zxid:0x20 txntype:2 reqpath:n/a 2011-04-29 11:09:43,387 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:delete cxid:0xa zxid:0x20 txntype:2 reqpath:n/a 2011-04-29 11:09:43,388 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,32,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:43,388 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:43,388 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:43,389 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,32,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:43,390 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:delete cxid:0xc zxid:0x21 txntype:2 reqpath:n/a 2011-04-29 11:09:43,391 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:delete cxid:0xc zxid:0x21 txntype:2 reqpath:n/a 2011-04-29 11:09:43,391 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,33,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:43,391 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:43,392 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:43,393 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='12') 2011-04-29 11:09:43,393 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='12') 2011-04-29 11:09:43,394 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:43,395 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:43,395 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:43,414 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:43,415 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@2635ee49] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:43,415 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,12] 2011-04-29 11:09:43,464 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,12] 2011-04-29 11:09:43,478 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:43,478 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:43,479 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:43,479 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:43,479 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:43,480 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0004 2011-04-29 11:09:43,480 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0004 2011-04-29 11:09:43,484 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0004 2011-04-29 11:09:43,485 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0004 type:closeSession cxid:0xd zxid:0x22 txntype:-11 reqpath:n/a 2011-04-29 11:09:43,486 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0004 type:closeSession cxid:0xd zxid:0x22 txntype:-11 reqpath:n/a 2011-04-29 11:09:43,493 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /0:0:0:0:0:0:0:1%0:56309 which had sessionid 0x12fa2738adb0004 2011-04-29 11:09:43,494 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0004, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,34,0 request:: null response:: null 2011-04-29 11:09:43,494 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0004 : Unable to read additional data from server sessionid 0x12fa2738adb0004, likely server has closed socket 2011-04-29 11:09:43,494 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:43,495 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0004 2011-04-29 11:09:43,495 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0004 closed 2011-04-29 11:09:43,496 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@63c9982e 2011-04-29 11:09:43,496 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:43,498 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:43,499 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:43,499 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56310 2011-04-29 11:09:43,499 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56310 client's lastZxid is 0x0 2011-04-29 11:09:43,499 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56310 2011-04-29 11:09:43,500 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:createSession cxid:0x0 zxid:0x23 txntype:-10 reqpath:n/a 2011-04-29 11:09:43,500 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:createSession cxid:0x0 zxid:0x23 txntype:-10 reqpath:n/a 2011-04-29 11:09:43,501 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0005 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56310 2011-04-29 11:09:43,501 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb0005, negotiated timeout = 40000 2011-04-29 11:09:43,502 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:create cxid:0x1 zxid:0x24 txntype:1 reqpath:n/a 2011-04-29 11:09:43,503 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:create cxid:0x1 zxid:0x24 txntype:1 reqpath:n/a 2011-04-29 11:09:43,503 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,36,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:43,505 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:create cxid:0x2 zxid:0x25 txntype:1 reqpath:n/a 2011-04-29 11:09:43,505 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:create cxid:0x2 zxid:0x25 txntype:1 reqpath:n/a 2011-04-29 11:09:43,506 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,37,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f37376630613161382d303633372d346263392d386537392d6337396564353430636262643a313330343130303538333438303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:43,507 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:43,507 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:43,508 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,37,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:43,509 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:create cxid:0x4 zxid:0x26 txntype:1 reqpath:n/a 2011-04-29 11:09:43,509 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:create cxid:0x4 zxid:0x26 txntype:1 reqpath:n/a 2011-04-29 11:09:43,510 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,38,0 request:: '/hive_zookeeper_namespace/default/srcpart,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:43,512 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:create cxid:0x5 zxid:0x27 txntype:1 reqpath:n/a 2011-04-29 11:09:43,512 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:create cxid:0x5 zxid:0x27 txntype:1 reqpath:n/a 2011-04-29 11:09:43,513 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,39,0 request:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f37376630613161382d303633372d346263392d386537392d6337396564353430636262643a313330343130303538333438303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:43,513 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:43,513 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:43,514 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,39,0 request:: '/hive_zookeeper_namespace/default/srcpart,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:43,514 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:43,515 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:43,515 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='12') 2011-04-29 11:09:43,516 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:43,516 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='12') 2011-04-29 11:09:43,516 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:43,516 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcpart 2011-04-29 11:09:43,516 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:43,517 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:43,517 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:43,518 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/kv1.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-43_393_7116227039162475452/-ext-10000 2011-04-29 11:09:43,553 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:43,663 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcpart partition (ds=2008-04-09, hr=12) from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-43_393_7116227039162475452/-ext-10000 2011-04-29 11:09:43,664 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:43,688 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:43,689 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@5f262a85] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:43,838 INFO exec.MoveTask (MoveTask.java:execute(203)) - Partition is: {ds=2008-04-09, hr=12} 2011-04-29 11:09:43,839 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:09:43,862 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcpart { string key, string value} 2011-04-29 11:09:43,863 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@7b553d18] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:43,864 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,12] 2011-04-29 11:09:43,983 DEBUG metadata.Hive (Hive.java:replaceFiles(1944)) - Renaming:pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-43_393_7116227039162475452/-ext-10000 to pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcpart/ds=2008-04-09/hr=12,Status:true 2011-04-29 11:09:43,983 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,12] 2011-04-29 11:09:43,999 DEBUG metadata.Hive (Hive.java:getPartition(1365)) - creating partition for table srcpart with partition spec : {ds=2008-04-09, hr=12} 2011-04-29 11:09:44,000 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: append_partition : db=default tbl=srcpart[2008-04-09,12] 2011-04-29 11:09:44,000 DEBUG metastore.HiveMetaStore (HiveMetaStore.java:append_partition(1189)) - 2008-04-09 2011-04-29 11:09:44,000 DEBUG metastore.HiveMetaStore (HiveMetaStore.java:append_partition(1189)) - 12 2011-04-29 11:09:44,089 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_partition_with_auth : db=default tbl=srcpart[2008-04-09,12] 2011-04-29 11:09:44,117 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,117 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' OVERWRITE INTO TABLE srcpart PARTITION (ds='2008-04-09',hr='12') 2011-04-29 11:09:44,117 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:44,118 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcpart 2011-04-29 11:09:44,118 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcpart@ds=2008-04-09/hr=12 2011-04-29 11:09:44,118 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,118 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,119 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:44,119 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,121 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:delete cxid:0x7 zxid:0x28 txntype:2 reqpath:n/a 2011-04-29 11:09:44,122 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:delete cxid:0x7 zxid:0x28 txntype:2 reqpath:n/a 2011-04-29 11:09:44,122 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,40,0 request:: '/hive_zookeeper_namespace/default/srcpart/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:44,123 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:44,123 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcpart 2011-04-29 11:09:44,124 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,40,0 request:: '/hive_zookeeper_namespace/default/srcpart,F response:: v{} 2011-04-29 11:09:44,125 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:delete cxid:0x9 zxid:0x29 txntype:2 reqpath:n/a 2011-04-29 11:09:44,125 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:delete cxid:0x9 zxid:0x29 txntype:2 reqpath:n/a 2011-04-29 11:09:44,126 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,41,0 request:: '/hive_zookeeper_namespace/default/srcpart,-1 response:: null 2011-04-29 11:09:44,127 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:delete cxid:0xa zxid:0x2a txntype:2 reqpath:n/a 2011-04-29 11:09:44,127 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:delete cxid:0xa zxid:0x2a txntype:2 reqpath:n/a 2011-04-29 11:09:44,128 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,42,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:44,128 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:44,128 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:44,129 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,42,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:44,130 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:delete cxid:0xc zxid:0x2b txntype:2 reqpath:n/a 2011-04-29 11:09:44,131 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:delete cxid:0xc zxid:0x2b txntype:2 reqpath:n/a 2011-04-29 11:09:44,131 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,43,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:44,131 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,132 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,132 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: CREATE TABLE srcbucket(key int, value string) CLUSTERED BY (key) INTO 2 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:44,133 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: CREATE TABLE srcbucket(key int, value string) CLUSTERED BY (key) INTO 2 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:44,140 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:44,145 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:09:44,147 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeCreateTable(7228)) - Creating table srcbucket position=13 2011-04-29 11:09:44,157 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:44,158 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:44,158 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,158 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,158 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,158 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,159 INFO ql.Driver (Driver.java:execute(972)) - Starting command: CREATE TABLE srcbucket(key int, value string) CLUSTERED BY (key) INTO 2 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:44,159 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,159 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: CREATE TABLE srcbucket(key int, value string) CLUSTERED BY (key) INTO 2 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:44,160 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: CREATETABLE 2011-04-29 11:09:44,160 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,160 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,160 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,161 INFO exec.DDLTask (DDLTask.java:createTable(3109)) - Default to LazySimpleSerDe for table srcbucket 2011-04-29 11:09:44,162 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:44,162 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@24e15497] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:44,163 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=srcbucket 2011-04-29 11:09:44,165 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcbucket 2011-04-29 11:09:44,315 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,316 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: CREATE TABLE srcbucket(key int, value string) CLUSTERED BY (key) INTO 2 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:44,316 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: CREATETABLE 2011-04-29 11:09:44,316 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcbucket 2011-04-29 11:09:44,316 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,317 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,317 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:44,317 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,318 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,318 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,318 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket0.txt' INTO TABLE srcbucket 2011-04-29 11:09:44,319 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket0.txt' INTO TABLE srcbucket 2011-04-29 11:09:44,320 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:44,320 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/srcbucket0.txt 2011-04-29 11:09:44,321 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:09:44,342 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:44,343 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@702a15d6] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:44,384 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:44,384 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:44,385 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:44,385 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,394 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,395 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0005 2011-04-29 11:09:44,395 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0005 2011-04-29 11:09:44,396 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0005 2011-04-29 11:09:44,397 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0005 type:closeSession cxid:0xd zxid:0x2c txntype:-11 reqpath:n/a 2011-04-29 11:09:44,397 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0005 type:closeSession cxid:0xd zxid:0x2c txntype:-11 reqpath:n/a 2011-04-29 11:09:44,398 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0005, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,44,0 request:: null response:: null 2011-04-29 11:09:44,398 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56310 which had sessionid 0x12fa2738adb0005 2011-04-29 11:09:44,398 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0005 2011-04-29 11:09:44,399 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0005 : Unable to read additional data from server sessionid 0x12fa2738adb0005, likely server has closed socket 2011-04-29 11:09:44,399 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0005 closed 2011-04-29 11:09:44,400 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:44,401 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@7213f866 2011-04-29 11:09:44,402 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:44,404 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:44,404 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56311 2011-04-29 11:09:44,404 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:44,406 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56311 client's lastZxid is 0x0 2011-04-29 11:09:44,406 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56311 2011-04-29 11:09:44,407 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:createSession cxid:0x0 zxid:0x2d txntype:-10 reqpath:n/a 2011-04-29 11:09:44,407 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:createSession cxid:0x0 zxid:0x2d txntype:-10 reqpath:n/a 2011-04-29 11:09:44,408 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0006 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56311 2011-04-29 11:09:44,408 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb0006, negotiated timeout = 40000 2011-04-29 11:09:44,409 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:create cxid:0x1 zxid:0x2e txntype:1 reqpath:n/a 2011-04-29 11:09:44,409 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:create cxid:0x1 zxid:0x2e txntype:1 reqpath:n/a 2011-04-29 11:09:44,410 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,46,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:44,412 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:create cxid:0x2 zxid:0x2f txntype:1 reqpath:n/a 2011-04-29 11:09:44,412 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:create cxid:0x2 zxid:0x2f txntype:1 reqpath:n/a 2011-04-29 11:09:44,413 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,47,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f34393437383032392d376166632d343166372d626163302d6134396266663366646135393a313330343130303538343339343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:44,413 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:44,414 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:44,414 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,47,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:44,416 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:create cxid:0x4 zxid:0x30 txntype:1 reqpath:n/a 2011-04-29 11:09:44,417 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:create cxid:0x4 zxid:0x30 txntype:1 reqpath:n/a 2011-04-29 11:09:44,417 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,48,0 request:: '/hive_zookeeper_namespace/default/srcbucket,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:44,419 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:create cxid:0x5 zxid:0x31 txntype:1 reqpath:n/a 2011-04-29 11:09:44,419 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:create cxid:0x5 zxid:0x31 txntype:1 reqpath:n/a 2011-04-29 11:09:44,420 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,49,0 request:: '/hive_zookeeper_namespace/default/srcbucket/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f34393437383032392d376166632d343166372d626163302d6134396266663366646135393a313330343130303538343339343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcbucket/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:44,421 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:44,421 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:44,421 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,49,0 request:: '/hive_zookeeper_namespace/default/srcbucket,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:44,422 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,422 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,422 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket0.txt' INTO TABLE srcbucket 2011-04-29 11:09:44,423 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,423 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket0.txt' INTO TABLE srcbucket 2011-04-29 11:09:44,424 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:44,424 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcbucket 2011-04-29 11:09:44,424 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,424 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,424 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,426 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/srcbucket0.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-44_319_6221855467372010211/-ext-10000 2011-04-29 11:09:44,462 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/srcbucket0.txt 2011-04-29 11:09:44,593 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcbucket from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-44_319_6221855467372010211/-ext-10000 2011-04-29 11:09:44,594 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:09:44,621 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:44,622 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@75d3ce2c] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:44,771 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:09:44,791 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:44,792 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@7a5f39b0] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:44,929 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=srcbucket newtbl=srcbucket 2011-04-29 11:09:44,980 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,981 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket0.txt' INTO TABLE srcbucket 2011-04-29 11:09:44,981 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:44,981 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcbucket 2011-04-29 11:09:44,981 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,982 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,982 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:44,982 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,984 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:delete cxid:0x7 zxid:0x32 txntype:2 reqpath:n/a 2011-04-29 11:09:44,985 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:delete cxid:0x7 zxid:0x32 txntype:2 reqpath:n/a 2011-04-29 11:09:44,985 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,50,0 request:: '/hive_zookeeper_namespace/default/srcbucket/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:44,986 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:44,986 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:44,987 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,50,0 request:: '/hive_zookeeper_namespace/default/srcbucket,F response:: v{} 2011-04-29 11:09:44,988 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:delete cxid:0x9 zxid:0x33 txntype:2 reqpath:n/a 2011-04-29 11:09:44,988 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:delete cxid:0x9 zxid:0x33 txntype:2 reqpath:n/a 2011-04-29 11:09:44,989 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,51,0 request:: '/hive_zookeeper_namespace/default/srcbucket,-1 response:: null 2011-04-29 11:09:44,990 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:delete cxid:0xa zxid:0x34 txntype:2 reqpath:n/a 2011-04-29 11:09:44,990 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:delete cxid:0xa zxid:0x34 txntype:2 reqpath:n/a 2011-04-29 11:09:44,991 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,52,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:44,991 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:44,991 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:44,992 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,52,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:44,993 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:delete cxid:0xc zxid:0x35 txntype:2 reqpath:n/a 2011-04-29 11:09:44,994 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:delete cxid:0xc zxid:0x35 txntype:2 reqpath:n/a 2011-04-29 11:09:44,994 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,53,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:44,994 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:44,995 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:44,995 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket1.txt' INTO TABLE srcbucket 2011-04-29 11:09:44,996 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket1.txt' INTO TABLE srcbucket 2011-04-29 11:09:44,997 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:44,997 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/srcbucket1.txt 2011-04-29 11:09:44,998 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:09:45,012 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:45,013 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@4822f558] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:45,050 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:45,051 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:45,052 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:45,052 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,052 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,053 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0006 2011-04-29 11:09:45,053 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0006 2011-04-29 11:09:45,057 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0006 2011-04-29 11:09:45,058 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0006 type:closeSession cxid:0xd zxid:0x36 txntype:-11 reqpath:n/a 2011-04-29 11:09:45,059 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0006 type:closeSession cxid:0xd zxid:0x36 txntype:-11 reqpath:n/a 2011-04-29 11:09:45,060 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0006, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,54,0 request:: null response:: null 2011-04-29 11:09:45,060 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56311 which had sessionid 0x12fa2738adb0006 2011-04-29 11:09:45,061 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0006 : Unable to read additional data from server sessionid 0x12fa2738adb0006, likely server has closed socket 2011-04-29 11:09:45,061 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:45,061 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0006 2011-04-29 11:09:45,062 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0006 closed 2011-04-29 11:09:45,062 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@18a3fe6 2011-04-29 11:09:45,062 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:09:45,066 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /0:0:0:0:0:0:0:1%0:56312 2011-04-29 11:09:45,066 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/0:0:0:0:0:0:0:1:21818, initiating session 2011-04-29 11:09:45,067 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:09:45,067 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /0:0:0:0:0:0:0:1%0:56312 client's lastZxid is 0x0 2011-04-29 11:09:45,067 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /0:0:0:0:0:0:0:1%0:56312 2011-04-29 11:09:45,068 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:createSession cxid:0x0 zxid:0x37 txntype:-10 reqpath:n/a 2011-04-29 11:09:45,069 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:createSession cxid:0x0 zxid:0x37 txntype:-10 reqpath:n/a 2011-04-29 11:09:45,070 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0007 with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1%0:56312 2011-04-29 11:09:45,070 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21818, sessionid = 0x12fa2738adb0007, negotiated timeout = 40000 2011-04-29 11:09:45,071 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:create cxid:0x1 zxid:0x38 txntype:1 reqpath:n/a 2011-04-29 11:09:45,071 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:create cxid:0x1 zxid:0x38 txntype:1 reqpath:n/a 2011-04-29 11:09:45,072 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,56,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:45,074 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:create cxid:0x2 zxid:0x39 txntype:1 reqpath:n/a 2011-04-29 11:09:45,074 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:create cxid:0x2 zxid:0x39 txntype:1 reqpath:n/a 2011-04-29 11:09:45,075 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,57,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f31323039323239632d653936392d343261392d626230302d3165353333343035383231383a313330343130303538353035323a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:45,076 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:45,076 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:45,077 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,57,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:45,078 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:create cxid:0x4 zxid:0x3a txntype:1 reqpath:n/a 2011-04-29 11:09:45,078 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:create cxid:0x4 zxid:0x3a txntype:1 reqpath:n/a 2011-04-29 11:09:45,079 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,58,0 request:: '/hive_zookeeper_namespace/default/srcbucket,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:45,081 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:create cxid:0x5 zxid:0x3b txntype:1 reqpath:n/a 2011-04-29 11:09:45,081 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:create cxid:0x5 zxid:0x3b txntype:1 reqpath:n/a 2011-04-29 11:09:45,082 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,59,0 request:: '/hive_zookeeper_namespace/default/srcbucket/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f31323039323239632d653936392d343261392d626230302d3165353333343035383231383a313330343130303538353035323a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcbucket/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:45,082 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:45,083 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:45,083 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,59,0 request:: '/hive_zookeeper_namespace/default/srcbucket,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:45,084 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,084 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,084 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket1.txt' INTO TABLE srcbucket 2011-04-29 11:09:45,085 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,085 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket1.txt' INTO TABLE srcbucket 2011-04-29 11:09:45,085 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:45,085 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcbucket 2011-04-29 11:09:45,086 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,086 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,086 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,087 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/srcbucket1.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-44_996_3122874911066745276/-ext-10000 2011-04-29 11:09:45,123 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/srcbucket1.txt 2011-04-29 11:09:45,284 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcbucket from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-44_996_3122874911066745276/-ext-10000 2011-04-29 11:09:45,285 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:09:45,308 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:45,308 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@a01ec0b] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:45,377 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:09:45,378 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:09:45,379 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(721)) - Got ping response for sessionid: 0x12fa2738adb0000 after 19ms 2011-04-29 11:09:45,452 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:09:45,482 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket { i32 key, string value} 2011-04-29 11:09:45,482 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@15aec462] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:45,624 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=srcbucket newtbl=srcbucket 2011-04-29 11:09:45,682 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,682 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket1.txt' INTO TABLE srcbucket 2011-04-29 11:09:45,683 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:45,683 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcbucket 2011-04-29 11:09:45,683 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,683 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,684 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:45,684 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,686 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:delete cxid:0x7 zxid:0x3c txntype:2 reqpath:n/a 2011-04-29 11:09:45,686 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:delete cxid:0x7 zxid:0x3c txntype:2 reqpath:n/a 2011-04-29 11:09:45,687 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,60,0 request:: '/hive_zookeeper_namespace/default/srcbucket/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:45,688 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:45,689 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket 2011-04-29 11:09:45,689 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,60,0 request:: '/hive_zookeeper_namespace/default/srcbucket,F response:: v{} 2011-04-29 11:09:45,690 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:delete cxid:0x9 zxid:0x3d txntype:2 reqpath:n/a 2011-04-29 11:09:45,691 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:delete cxid:0x9 zxid:0x3d txntype:2 reqpath:n/a 2011-04-29 11:09:45,693 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,61,0 request:: '/hive_zookeeper_namespace/default/srcbucket,-1 response:: null 2011-04-29 11:09:45,694 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:delete cxid:0xa zxid:0x3e txntype:2 reqpath:n/a 2011-04-29 11:09:45,694 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:delete cxid:0xa zxid:0x3e txntype:2 reqpath:n/a 2011-04-29 11:09:45,695 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,62,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:45,695 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:45,695 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:45,696 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,62,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:45,697 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:delete cxid:0xc zxid:0x3f txntype:2 reqpath:n/a 2011-04-29 11:09:45,698 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:delete cxid:0xc zxid:0x3f txntype:2 reqpath:n/a 2011-04-29 11:09:45,698 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,63,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:45,698 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,699 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,699 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: CREATE TABLE srcbucket2(key int, value string) CLUSTERED BY (key) INTO 4 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:45,700 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: CREATE TABLE srcbucket2(key int, value string) CLUSTERED BY (key) INTO 4 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:45,701 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:45,701 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:09:45,702 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeCreateTable(7228)) - Creating table srcbucket2 position=13 2011-04-29 11:09:45,702 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:45,703 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:45,703 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,703 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,703 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,703 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,704 INFO ql.Driver (Driver.java:execute(972)) - Starting command: CREATE TABLE srcbucket2(key int, value string) CLUSTERED BY (key) INTO 4 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:45,704 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,704 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: CREATE TABLE srcbucket2(key int, value string) CLUSTERED BY (key) INTO 4 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:45,704 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: CREATETABLE 2011-04-29 11:09:45,705 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,705 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,705 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,706 INFO exec.DDLTask (DDLTask.java:createTable(3109)) - Default to LazySimpleSerDe for table srcbucket2 2011-04-29 11:09:45,706 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:45,707 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@3274eb8a] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:45,707 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=srcbucket2 2011-04-29 11:09:45,710 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcbucket2 2011-04-29 11:09:45,773 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,774 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: CREATE TABLE srcbucket2(key int, value string) CLUSTERED BY (key) INTO 4 BUCKETS STORED AS TEXTFILE 2011-04-29 11:09:45,774 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: CREATETABLE 2011-04-29 11:09:45,774 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcbucket2 2011-04-29 11:09:45,775 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,775 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,775 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:45,775 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,775 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,776 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,776 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket20.txt' INTO TABLE srcbucket2 2011-04-29 11:09:45,777 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket20.txt' INTO TABLE srcbucket2 2011-04-29 11:09:45,777 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:45,778 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/srcbucket20.txt 2011-04-29 11:09:45,778 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:45,795 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:45,796 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@611c048e] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:45,833 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:45,834 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:45,834 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:45,835 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,835 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,835 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0007 2011-04-29 11:09:45,836 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0007 2011-04-29 11:09:45,839 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0007 2011-04-29 11:09:45,840 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0007 type:closeSession cxid:0xd zxid:0x40 txntype:-11 reqpath:n/a 2011-04-29 11:09:45,841 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0007 type:closeSession cxid:0xd zxid:0x40 txntype:-11 reqpath:n/a 2011-04-29 11:09:45,842 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0007, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,64,0 request:: null response:: null 2011-04-29 11:09:45,842 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /0:0:0:0:0:0:0:1%0:56312 which had sessionid 0x12fa2738adb0007 2011-04-29 11:09:45,842 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0007 : Unable to read additional data from server sessionid 0x12fa2738adb0007, likely server has closed socket 2011-04-29 11:09:45,842 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0007 2011-04-29 11:09:45,842 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:45,843 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0007 closed 2011-04-29 11:09:45,843 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@22666c7a 2011-04-29 11:09:45,844 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:09:45,846 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:09:45,846 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56313 2011-04-29 11:09:45,846 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:09:45,847 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56313 client's lastZxid is 0x0 2011-04-29 11:09:45,847 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56313 2011-04-29 11:09:45,848 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:createSession cxid:0x0 zxid:0x41 txntype:-10 reqpath:n/a 2011-04-29 11:09:45,848 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:createSession cxid:0x0 zxid:0x41 txntype:-10 reqpath:n/a 2011-04-29 11:09:45,849 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0008 with negotiated timeout 40000 for client /127.0.0.1:56313 2011-04-29 11:09:45,849 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb0008, negotiated timeout = 40000 2011-04-29 11:09:45,850 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:create cxid:0x1 zxid:0x42 txntype:1 reqpath:n/a 2011-04-29 11:09:45,850 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:create cxid:0x1 zxid:0x42 txntype:1 reqpath:n/a 2011-04-29 11:09:45,851 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,66,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:45,852 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:create cxid:0x2 zxid:0x43 txntype:1 reqpath:n/a 2011-04-29 11:09:45,853 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:create cxid:0x2 zxid:0x43 txntype:1 reqpath:n/a 2011-04-29 11:09:45,854 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,67,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f39633766386133652d363134642d343566382d386130632d3863373661656339633262353a313330343130303538353833353a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:45,854 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:45,854 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:45,855 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,67,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:45,856 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:create cxid:0x4 zxid:0x44 txntype:1 reqpath:n/a 2011-04-29 11:09:45,857 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:create cxid:0x4 zxid:0x44 txntype:1 reqpath:n/a 2011-04-29 11:09:45,857 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,68,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:45,858 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:create cxid:0x5 zxid:0x45 txntype:1 reqpath:n/a 2011-04-29 11:09:45,859 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:create cxid:0x5 zxid:0x45 txntype:1 reqpath:n/a 2011-04-29 11:09:45,860 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,69,0 request:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f39633766386133652d363134642d343566382d386130632d3863373661656339633262353a313330343130303538353833353a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:45,860 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:45,860 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:45,861 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,69,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:45,861 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,862 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,862 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket20.txt' INTO TABLE srcbucket2 2011-04-29 11:09:45,863 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,863 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket20.txt' INTO TABLE srcbucket2 2011-04-29 11:09:45,863 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:45,863 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcbucket2 2011-04-29 11:09:45,863 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,864 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:45,864 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:45,865 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/srcbucket20.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-45_776_3047602205019855432/-ext-10000 2011-04-29 11:09:45,903 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/srcbucket20.txt 2011-04-29 11:09:46,019 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcbucket2 from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-45_776_3047602205019855432/-ext-10000 2011-04-29 11:09:46,020 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:46,040 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:46,041 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@108b1a8f] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:46,196 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:46,216 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:46,217 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@7442df79] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:46,358 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=srcbucket2 newtbl=srcbucket2 2011-04-29 11:09:46,397 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:46,397 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket20.txt' INTO TABLE srcbucket2 2011-04-29 11:09:46,397 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:46,398 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcbucket2 2011-04-29 11:09:46,398 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:46,398 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:46,399 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:46,399 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:46,401 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:delete cxid:0x7 zxid:0x46 txntype:2 reqpath:n/a 2011-04-29 11:09:46,401 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:delete cxid:0x7 zxid:0x46 txntype:2 reqpath:n/a 2011-04-29 11:09:46,402 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,70,0 request:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:46,403 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:46,403 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:46,403 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,70,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,F response:: v{} 2011-04-29 11:09:46,405 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:delete cxid:0x9 zxid:0x47 txntype:2 reqpath:n/a 2011-04-29 11:09:46,405 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:delete cxid:0x9 zxid:0x47 txntype:2 reqpath:n/a 2011-04-29 11:09:46,405 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,71,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,-1 response:: null 2011-04-29 11:09:46,407 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:delete cxid:0xa zxid:0x48 txntype:2 reqpath:n/a 2011-04-29 11:09:46,407 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:delete cxid:0xa zxid:0x48 txntype:2 reqpath:n/a 2011-04-29 11:09:46,407 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,72,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:46,408 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:46,408 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:46,409 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,72,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:46,410 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:delete cxid:0xc zxid:0x49 txntype:2 reqpath:n/a 2011-04-29 11:09:46,417 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:delete cxid:0xc zxid:0x49 txntype:2 reqpath:n/a 2011-04-29 11:09:46,418 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,73,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:46,418 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:46,419 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:46,419 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket21.txt' INTO TABLE srcbucket2 2011-04-29 11:09:46,420 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket21.txt' INTO TABLE srcbucket2 2011-04-29 11:09:46,420 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:46,421 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/srcbucket21.txt 2011-04-29 11:09:46,421 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:46,435 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:46,436 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@7fd6dad8] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:46,472 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:46,473 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:46,473 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:46,474 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:46,474 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:46,474 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0008 2011-04-29 11:09:46,475 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0008 2011-04-29 11:09:46,479 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0008 2011-04-29 11:09:46,480 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0008 type:closeSession cxid:0xd zxid:0x4a txntype:-11 reqpath:n/a 2011-04-29 11:09:46,481 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0008 type:closeSession cxid:0xd zxid:0x4a txntype:-11 reqpath:n/a 2011-04-29 11:09:46,481 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0008, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,74,0 request:: null response:: null 2011-04-29 11:09:46,482 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56313 which had sessionid 0x12fa2738adb0008 2011-04-29 11:09:46,482 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0008 2011-04-29 11:09:46,482 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0008 : Unable to read additional data from server sessionid 0x12fa2738adb0008, likely server has closed socket 2011-04-29 11:09:46,482 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0008 closed 2011-04-29 11:09:46,484 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:46,484 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@8ff557a 2011-04-29 11:09:46,485 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:09:46,487 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:09:46,487 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56314 2011-04-29 11:09:46,488 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:09:46,488 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56314 client's lastZxid is 0x0 2011-04-29 11:09:46,488 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56314 2011-04-29 11:09:46,489 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:createSession cxid:0x0 zxid:0x4b txntype:-10 reqpath:n/a 2011-04-29 11:09:46,490 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:createSession cxid:0x0 zxid:0x4b txntype:-10 reqpath:n/a 2011-04-29 11:09:46,490 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0009 with negotiated timeout 40000 for client /127.0.0.1:56314 2011-04-29 11:09:46,490 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb0009, negotiated timeout = 40000 2011-04-29 11:09:46,491 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:create cxid:0x1 zxid:0x4c txntype:1 reqpath:n/a 2011-04-29 11:09:46,492 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:create cxid:0x1 zxid:0x4c txntype:1 reqpath:n/a 2011-04-29 11:09:46,493 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,76,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:46,495 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:create cxid:0x2 zxid:0x4d txntype:1 reqpath:n/a 2011-04-29 11:09:46,496 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:create cxid:0x2 zxid:0x4d txntype:1 reqpath:n/a 2011-04-29 11:09:46,497 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,77,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f39653038613332302d636432622d343966632d613139652d3164623861633562353638393a313330343130303538363437343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:46,497 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:46,498 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:46,498 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,77,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:46,500 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:create cxid:0x4 zxid:0x4e txntype:1 reqpath:n/a 2011-04-29 11:09:46,500 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:create cxid:0x4 zxid:0x4e txntype:1 reqpath:n/a 2011-04-29 11:09:46,501 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,78,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:46,503 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:create cxid:0x5 zxid:0x4f txntype:1 reqpath:n/a 2011-04-29 11:09:46,503 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:create cxid:0x5 zxid:0x4f txntype:1 reqpath:n/a 2011-04-29 11:09:46,504 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,79,0 request:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f39653038613332302d636432622d343966632d613139652d3164623861633562353638393a313330343130303538363437343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:46,505 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:46,505 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:46,505 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,79,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:46,506 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:46,506 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:46,506 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket21.txt' INTO TABLE srcbucket2 2011-04-29 11:09:46,507 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:46,507 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket21.txt' INTO TABLE srcbucket2 2011-04-29 11:09:46,507 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:46,508 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcbucket2 2011-04-29 11:09:46,508 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:46,508 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:46,508 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:46,509 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/srcbucket21.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-46_419_2130305804648174440/-ext-10000 2011-04-29 11:09:46,545 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/srcbucket21.txt 2011-04-29 11:09:46,660 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcbucket2 from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-46_419_2130305804648174440/-ext-10000 2011-04-29 11:09:46,661 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:46,679 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:46,680 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@39e6258e] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:46,826 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:46,845 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:46,845 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@16562d4b] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:46,983 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=srcbucket2 newtbl=srcbucket2 2011-04-29 11:09:47,027 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,028 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket21.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,028 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:47,028 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcbucket2 2011-04-29 11:09:47,028 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,029 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,029 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:47,029 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,031 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:delete cxid:0x7 zxid:0x50 txntype:2 reqpath:n/a 2011-04-29 11:09:47,032 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:delete cxid:0x7 zxid:0x50 txntype:2 reqpath:n/a 2011-04-29 11:09:47,033 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,80,0 request:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:47,033 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,033 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,034 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,80,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,F response:: v{} 2011-04-29 11:09:47,035 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:delete cxid:0x9 zxid:0x51 txntype:2 reqpath:n/a 2011-04-29 11:09:47,035 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:delete cxid:0x9 zxid:0x51 txntype:2 reqpath:n/a 2011-04-29 11:09:47,036 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,81,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,-1 response:: null 2011-04-29 11:09:47,037 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:delete cxid:0xa zxid:0x52 txntype:2 reqpath:n/a 2011-04-29 11:09:47,037 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:delete cxid:0xa zxid:0x52 txntype:2 reqpath:n/a 2011-04-29 11:09:47,038 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,82,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:47,038 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:47,039 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:47,039 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,82,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:47,041 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:delete cxid:0xc zxid:0x53 txntype:2 reqpath:n/a 2011-04-29 11:09:47,041 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:delete cxid:0xc zxid:0x53 txntype:2 reqpath:n/a 2011-04-29 11:09:47,041 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,83,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:47,042 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,042 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,043 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket22.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,043 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket22.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,044 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:47,045 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/srcbucket22.txt 2011-04-29 11:09:47,045 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:47,060 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:47,061 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@4ef37160] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:47,103 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:47,104 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:47,105 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:47,105 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,105 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,106 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0009 2011-04-29 11:09:47,106 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0009 2011-04-29 11:09:47,110 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0009 2011-04-29 11:09:47,111 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0009 type:closeSession cxid:0xd zxid:0x54 txntype:-11 reqpath:n/a 2011-04-29 11:09:47,111 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0009 type:closeSession cxid:0xd zxid:0x54 txntype:-11 reqpath:n/a 2011-04-29 11:09:47,112 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56314 which had sessionid 0x12fa2738adb0009 2011-04-29 11:09:47,114 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0009, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,84,0 request:: null response:: null 2011-04-29 11:09:47,114 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0009 : Unable to read additional data from server sessionid 0x12fa2738adb0009, likely server has closed socket 2011-04-29 11:09:47,114 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:47,114 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0009 2011-04-29 11:09:47,115 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0009 closed 2011-04-29 11:09:47,115 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@6a5714de 2011-04-29 11:09:47,117 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:47,118 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:47,118 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56315 2011-04-29 11:09:47,118 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:47,119 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56315 client's lastZxid is 0x0 2011-04-29 11:09:47,119 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56315 2011-04-29 11:09:47,120 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:createSession cxid:0x0 zxid:0x55 txntype:-10 reqpath:n/a 2011-04-29 11:09:47,120 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:createSession cxid:0x0 zxid:0x55 txntype:-10 reqpath:n/a 2011-04-29 11:09:47,121 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb000a with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56315 2011-04-29 11:09:47,121 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb000a, negotiated timeout = 40000 2011-04-29 11:09:47,122 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:create cxid:0x1 zxid:0x56 txntype:1 reqpath:n/a 2011-04-29 11:09:47,122 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:create cxid:0x1 zxid:0x56 txntype:1 reqpath:n/a 2011-04-29 11:09:47,123 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,86,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:47,125 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:create cxid:0x2 zxid:0x57 txntype:1 reqpath:n/a 2011-04-29 11:09:47,125 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:create cxid:0x2 zxid:0x57 txntype:1 reqpath:n/a 2011-04-29 11:09:47,126 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,87,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f34623535353930332d336365392d343532642d383561312d6566363865376436336562643a313330343130303538373130363a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:47,126 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:47,126 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:47,127 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,87,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:47,128 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:create cxid:0x4 zxid:0x58 txntype:1 reqpath:n/a 2011-04-29 11:09:47,129 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:create cxid:0x4 zxid:0x58 txntype:1 reqpath:n/a 2011-04-29 11:09:47,129 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,88,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,131 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:create cxid:0x5 zxid:0x59 txntype:1 reqpath:n/a 2011-04-29 11:09:47,131 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:create cxid:0x5 zxid:0x59 txntype:1 reqpath:n/a 2011-04-29 11:09:47,132 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,89,0 request:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f34623535353930332d336365392d343532642d383561312d6566363865376436336562643a313330343130303538373130363a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:47,132 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,133 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,133 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,89,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:47,134 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,134 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,134 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket22.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,135 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,135 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket22.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,135 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:47,135 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcbucket2 2011-04-29 11:09:47,136 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,136 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,136 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,137 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/srcbucket22.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-47_043_2867666827010375887/-ext-10000 2011-04-29 11:09:47,173 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/srcbucket22.txt 2011-04-29 11:09:47,287 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcbucket2 from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-47_043_2867666827010375887/-ext-10000 2011-04-29 11:09:47,288 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:47,308 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:47,309 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@1f421ab0] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:47,460 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:47,479 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:47,479 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@507895d8] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:47,618 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=srcbucket2 newtbl=srcbucket2 2011-04-29 11:09:47,655 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,656 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket22.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,656 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:47,656 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcbucket2 2011-04-29 11:09:47,656 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,657 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,657 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:47,657 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,659 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:delete cxid:0x7 zxid:0x5a txntype:2 reqpath:n/a 2011-04-29 11:09:47,660 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:delete cxid:0x7 zxid:0x5a txntype:2 reqpath:n/a 2011-04-29 11:09:47,661 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,90,0 request:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:47,662 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,662 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,663 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,90,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,F response:: v{} 2011-04-29 11:09:47,664 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:delete cxid:0x9 zxid:0x5b txntype:2 reqpath:n/a 2011-04-29 11:09:47,664 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:delete cxid:0x9 zxid:0x5b txntype:2 reqpath:n/a 2011-04-29 11:09:47,665 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,91,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,-1 response:: null 2011-04-29 11:09:47,666 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:delete cxid:0xa zxid:0x5c txntype:2 reqpath:n/a 2011-04-29 11:09:47,666 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:delete cxid:0xa zxid:0x5c txntype:2 reqpath:n/a 2011-04-29 11:09:47,667 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,92,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:47,668 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:47,668 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:47,668 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,92,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:47,671 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:delete cxid:0xc zxid:0x5d txntype:2 reqpath:n/a 2011-04-29 11:09:47,671 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:delete cxid:0xc zxid:0x5d txntype:2 reqpath:n/a 2011-04-29 11:09:47,672 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,93,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:47,672 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,673 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,673 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket23.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,674 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket23.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,675 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:47,675 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/srcbucket23.txt 2011-04-29 11:09:47,676 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:47,690 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:47,691 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@5f81a4ab] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:47,729 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:47,730 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:47,731 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:47,731 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,731 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,732 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb000a 2011-04-29 11:09:47,732 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb000a 2011-04-29 11:09:47,737 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb000a 2011-04-29 11:09:47,738 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000a type:closeSession cxid:0xd zxid:0x5e txntype:-11 reqpath:n/a 2011-04-29 11:09:47,738 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000a type:closeSession cxid:0xd zxid:0x5e txntype:-11 reqpath:n/a 2011-04-29 11:09:47,739 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000a, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,94,0 request:: null response:: null 2011-04-29 11:09:47,739 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56315 which had sessionid 0x12fa2738adb000a 2011-04-29 11:09:47,739 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb000a 2011-04-29 11:09:47,740 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb000a : Unable to read additional data from server sessionid 0x12fa2738adb000a, likely server has closed socket 2011-04-29 11:09:47,740 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:47,740 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb000a closed 2011-04-29 11:09:47,741 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@5028d3de 2011-04-29 11:09:47,741 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:47,742 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:47,742 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56316 2011-04-29 11:09:47,743 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:47,743 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56316 client's lastZxid is 0x0 2011-04-29 11:09:47,743 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56316 2011-04-29 11:09:47,744 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:createSession cxid:0x0 zxid:0x5f txntype:-10 reqpath:n/a 2011-04-29 11:09:47,744 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:createSession cxid:0x0 zxid:0x5f txntype:-10 reqpath:n/a 2011-04-29 11:09:47,745 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb000b with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56316 2011-04-29 11:09:47,745 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb000b, negotiated timeout = 40000 2011-04-29 11:09:47,746 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:create cxid:0x1 zxid:0x60 txntype:1 reqpath:n/a 2011-04-29 11:09:47,746 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:create cxid:0x1 zxid:0x60 txntype:1 reqpath:n/a 2011-04-29 11:09:47,747 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,96,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:47,748 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:create cxid:0x2 zxid:0x61 txntype:1 reqpath:n/a 2011-04-29 11:09:47,749 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:create cxid:0x2 zxid:0x61 txntype:1 reqpath:n/a 2011-04-29 11:09:47,750 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,97,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f30633137353932632d633234662d346538302d393462362d3062303638333762643236313a313330343130303538373733323a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:47,750 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:47,750 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:47,751 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,97,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:47,752 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:create cxid:0x4 zxid:0x62 txntype:1 reqpath:n/a 2011-04-29 11:09:47,753 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:create cxid:0x4 zxid:0x62 txntype:1 reqpath:n/a 2011-04-29 11:09:47,754 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,98,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,755 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:create cxid:0x5 zxid:0x63 txntype:1 reqpath:n/a 2011-04-29 11:09:47,755 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:create cxid:0x5 zxid:0x63 txntype:1 reqpath:n/a 2011-04-29 11:09:47,756 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,99,0 request:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f30633137353932632d633234662d346538302d393462362d3062303638333762643236313a313330343130303538373733323a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:47,756 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,757 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:47,757 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,99,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:47,758 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,758 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,758 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket23.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,759 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,759 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket23.txt' INTO TABLE srcbucket2 2011-04-29 11:09:47,759 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:47,760 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@srcbucket2 2011-04-29 11:09:47,760 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,760 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:47,760 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:47,761 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/srcbucket23.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-47_674_6999171834497820005/-ext-10000 2011-04-29 11:09:47,800 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/srcbucket23.txt 2011-04-29 11:09:47,917 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.srcbucket2 from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-47_674_6999171834497820005/-ext-10000 2011-04-29 11:09:47,918 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:47,937 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:47,937 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@29792d2c] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:48,083 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:09:48,104 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct srcbucket2 { i32 key, string value} 2011-04-29 11:09:48,104 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[int, string] separator=[[B@cbbaf] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:48,260 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=srcbucket2 newtbl=srcbucket2 2011-04-29 11:09:48,299 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:48,299 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/srcbucket23.txt' INTO TABLE srcbucket2 2011-04-29 11:09:48,299 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:48,300 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@srcbucket2 2011-04-29 11:09:48,300 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:48,300 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:48,300 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:48,301 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:48,303 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:delete cxid:0x7 zxid:0x64 txntype:2 reqpath:n/a 2011-04-29 11:09:48,303 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:delete cxid:0x7 zxid:0x64 txntype:2 reqpath:n/a 2011-04-29 11:09:48,304 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,100,0 request:: '/hive_zookeeper_namespace/default/srcbucket2/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:48,304 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:48,304 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/srcbucket2 2011-04-29 11:09:48,305 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,100,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,F response:: v{} 2011-04-29 11:09:48,306 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:delete cxid:0x9 zxid:0x65 txntype:2 reqpath:n/a 2011-04-29 11:09:48,307 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:delete cxid:0x9 zxid:0x65 txntype:2 reqpath:n/a 2011-04-29 11:09:48,307 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,101,0 request:: '/hive_zookeeper_namespace/default/srcbucket2,-1 response:: null 2011-04-29 11:09:48,308 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:delete cxid:0xa zxid:0x66 txntype:2 reqpath:n/a 2011-04-29 11:09:48,308 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:delete cxid:0xa zxid:0x66 txntype:2 reqpath:n/a 2011-04-29 11:09:48,309 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,102,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:48,309 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:48,310 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:48,310 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,102,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:48,311 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:delete cxid:0xc zxid:0x67 txntype:2 reqpath:n/a 2011-04-29 11:09:48,312 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:delete cxid:0xc zxid:0x67 txntype:2 reqpath:n/a 2011-04-29 11:09:48,312 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,103,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:48,312 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:48,313 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:48,314 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@523bd44c] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:48,314 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=src 2011-04-29 11:09:48,317 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src 2011-04-29 11:09:48,373 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src1 { string key, string value} 2011-04-29 11:09:48,375 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@720bffd] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:48,375 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=src1 2011-04-29 11:09:48,378 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src1 2011-04-29 11:09:48,470 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_sequencefile { string key, string value} 2011-04-29 11:09:48,471 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@413849df] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:48,479 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=src_sequencefile 2011-04-29 11:09:48,482 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_sequencefile 2011-04-29 11:09:48,583 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_thrift { } 2011-04-29 11:09:48,621 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=src_thrift 2011-04-29 11:09:48,623 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_thrift 2011-04-29 11:09:48,680 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_json { string json} 2011-04-29 11:09:48,680 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[json] columnTypes=[string] separator=[[B@3ed3e5cc] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:48,681 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=src_json 2011-04-29 11:09:48,683 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_json 2011-04-29 11:09:48,740 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:48,740 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' INTO TABLE src 2011-04-29 11:09:48,741 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' INTO TABLE src 2011-04-29 11:09:48,742 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:48,742 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:48,743 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src 2011-04-29 11:09:48,758 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:48,759 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@6c4d44af] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:48,798 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:48,798 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:48,799 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:48,799 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:48,800 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:48,800 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb000b 2011-04-29 11:09:48,800 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb000b 2011-04-29 11:09:48,803 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb000b 2011-04-29 11:09:48,804 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000b type:closeSession cxid:0xd zxid:0x68 txntype:-11 reqpath:n/a 2011-04-29 11:09:48,804 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000b type:closeSession cxid:0xd zxid:0x68 txntype:-11 reqpath:n/a 2011-04-29 11:09:48,805 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000b, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,104,0 request:: null response:: null 2011-04-29 11:09:48,806 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56316 which had sessionid 0x12fa2738adb000b 2011-04-29 11:09:48,806 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb000b 2011-04-29 11:09:48,806 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb000b : Unable to read additional data from server sessionid 0x12fa2738adb000b, likely server has closed socket 2011-04-29 11:09:48,806 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb000b closed 2011-04-29 11:09:48,806 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:48,807 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@16881734 2011-04-29 11:09:48,808 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:09:48,808 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:09:48,808 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56317 2011-04-29 11:09:48,809 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:09:48,809 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56317 client's lastZxid is 0x0 2011-04-29 11:09:48,809 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56317 2011-04-29 11:09:48,810 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:createSession cxid:0x0 zxid:0x69 txntype:-10 reqpath:n/a 2011-04-29 11:09:48,810 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:createSession cxid:0x0 zxid:0x69 txntype:-10 reqpath:n/a 2011-04-29 11:09:48,811 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb000c with negotiated timeout 40000 for client /127.0.0.1:56317 2011-04-29 11:09:48,811 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb000c, negotiated timeout = 40000 2011-04-29 11:09:48,812 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:create cxid:0x1 zxid:0x6a txntype:1 reqpath:n/a 2011-04-29 11:09:48,813 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:create cxid:0x1 zxid:0x6a txntype:1 reqpath:n/a 2011-04-29 11:09:48,813 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,106,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:48,815 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:create cxid:0x2 zxid:0x6b txntype:1 reqpath:n/a 2011-04-29 11:09:48,815 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:create cxid:0x2 zxid:0x6b txntype:1 reqpath:n/a 2011-04-29 11:09:48,816 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,107,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f64653666666662352d366331662d346532612d623036352d6234363433326230323737363a313330343130303538383830303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:48,817 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:48,817 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:48,817 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,107,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:48,819 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:create cxid:0x4 zxid:0x6c txntype:1 reqpath:n/a 2011-04-29 11:09:48,819 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:create cxid:0x4 zxid:0x6c txntype:1 reqpath:n/a 2011-04-29 11:09:48,820 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,108,0 request:: '/hive_zookeeper_namespace/default/src,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/src 2011-04-29 11:09:48,821 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:create cxid:0x5 zxid:0x6d txntype:1 reqpath:n/a 2011-04-29 11:09:48,822 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:create cxid:0x5 zxid:0x6d txntype:1 reqpath:n/a 2011-04-29 11:09:48,822 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,109,0 request:: '/hive_zookeeper_namespace/default/src/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f64653666666662352d366331662d346532612d623036352d6234363433326230323737363a313330343130303538383830303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/src/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:48,823 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:09:48,823 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:09:48,824 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,109,0 request:: '/hive_zookeeper_namespace/default/src,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:48,824 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:48,824 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:48,824 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' INTO TABLE src 2011-04-29 11:09:48,825 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:48,825 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' INTO TABLE src 2011-04-29 11:09:48,826 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:48,826 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@src 2011-04-29 11:09:48,826 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:48,826 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:48,826 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:48,827 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/kv1.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-48_741_5608064448696193145/-ext-10000 2011-04-29 11:09:48,863 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/kv1.txt 2011-04-29 11:09:48,977 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.src from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-48_741_5608064448696193145/-ext-10000 2011-04-29 11:09:48,978 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src 2011-04-29 11:09:48,996 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:48,997 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@252c55fd] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:49,136 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src 2011-04-29 11:09:49,161 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:49,162 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@4e33c558] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:49,308 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=src newtbl=src 2011-04-29 11:09:49,357 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:49,357 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.txt' INTO TABLE src 2011-04-29 11:09:49,357 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:49,358 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@src 2011-04-29 11:09:49,358 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:49,358 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:49,359 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:49,359 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:49,363 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:delete cxid:0x7 zxid:0x6e txntype:2 reqpath:n/a 2011-04-29 11:09:49,364 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:delete cxid:0x7 zxid:0x6e txntype:2 reqpath:n/a 2011-04-29 11:09:49,365 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,110,0 request:: '/hive_zookeeper_namespace/default/src/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:49,366 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:09:49,366 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:09:49,367 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,110,0 request:: '/hive_zookeeper_namespace/default/src,F response:: v{} 2011-04-29 11:09:49,368 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:delete cxid:0x9 zxid:0x6f txntype:2 reqpath:n/a 2011-04-29 11:09:49,368 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:delete cxid:0x9 zxid:0x6f txntype:2 reqpath:n/a 2011-04-29 11:09:49,369 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,111,0 request:: '/hive_zookeeper_namespace/default/src,-1 response:: null 2011-04-29 11:09:49,370 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:delete cxid:0xa zxid:0x70 txntype:2 reqpath:n/a 2011-04-29 11:09:49,371 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:delete cxid:0xa zxid:0x70 txntype:2 reqpath:n/a 2011-04-29 11:09:49,371 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,112,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:49,372 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:49,372 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:49,373 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,112,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:49,375 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:delete cxid:0xc zxid:0x71 txntype:2 reqpath:n/a 2011-04-29 11:09:49,375 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:delete cxid:0xc zxid:0x71 txntype:2 reqpath:n/a 2011-04-29 11:09:49,376 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,113,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:49,376 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:49,377 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:49,377 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv3.txt' INTO TABLE src1 2011-04-29 11:09:49,378 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv3.txt' INTO TABLE src1 2011-04-29 11:09:49,378 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:49,379 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/kv3.txt 2011-04-29 11:09:49,380 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src1 2011-04-29 11:09:49,445 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src1 { string key, string value} 2011-04-29 11:09:49,446 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@37ada1e0] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:49,510 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src1 { string key, string value} 2011-04-29 11:09:49,510 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:49,511 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:49,511 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:49,512 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:49,512 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb000c 2011-04-29 11:09:49,512 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb000c 2011-04-29 11:09:49,516 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb000c 2011-04-29 11:09:49,518 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000c type:closeSession cxid:0xd zxid:0x72 txntype:-11 reqpath:n/a 2011-04-29 11:09:49,519 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000c type:closeSession cxid:0xd zxid:0x72 txntype:-11 reqpath:n/a 2011-04-29 11:09:49,520 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000c, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,114,0 request:: null response:: null 2011-04-29 11:09:49,520 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56317 which had sessionid 0x12fa2738adb000c 2011-04-29 11:09:49,521 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb000c : Unable to read additional data from server sessionid 0x12fa2738adb000c, likely server has closed socket 2011-04-29 11:09:49,521 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:49,521 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb000c 2011-04-29 11:09:49,522 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb000c closed 2011-04-29 11:09:49,523 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@32f02db7 2011-04-29 11:09:49,523 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:49,524 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56318 2011-04-29 11:09:49,525 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:49,525 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:49,525 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56318 client's lastZxid is 0x0 2011-04-29 11:09:49,526 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56318 2011-04-29 11:09:49,527 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:createSession cxid:0x0 zxid:0x73 txntype:-10 reqpath:n/a 2011-04-29 11:09:49,527 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:createSession cxid:0x0 zxid:0x73 txntype:-10 reqpath:n/a 2011-04-29 11:09:49,528 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb000d with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56318 2011-04-29 11:09:49,528 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb000d, negotiated timeout = 40000 2011-04-29 11:09:49,530 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:create cxid:0x1 zxid:0x74 txntype:1 reqpath:n/a 2011-04-29 11:09:49,531 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:create cxid:0x1 zxid:0x74 txntype:1 reqpath:n/a 2011-04-29 11:09:49,532 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,116,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:49,534 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:create cxid:0x2 zxid:0x75 txntype:1 reqpath:n/a 2011-04-29 11:09:49,534 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:create cxid:0x2 zxid:0x75 txntype:1 reqpath:n/a 2011-04-29 11:09:49,535 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,117,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f32643961383138322d666362372d346533302d386364662d3534323230303437343232363a313330343130303538393531323a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:49,536 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:49,536 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:49,537 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,117,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:49,539 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:create cxid:0x4 zxid:0x76 txntype:1 reqpath:n/a 2011-04-29 11:09:49,540 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:create cxid:0x4 zxid:0x76 txntype:1 reqpath:n/a 2011-04-29 11:09:49,541 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,118,0 request:: '/hive_zookeeper_namespace/default/src1,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/src1 2011-04-29 11:09:49,543 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:create cxid:0x5 zxid:0x77 txntype:1 reqpath:n/a 2011-04-29 11:09:49,543 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:create cxid:0x5 zxid:0x77 txntype:1 reqpath:n/a 2011-04-29 11:09:49,544 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,119,0 request:: '/hive_zookeeper_namespace/default/src1/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f32643961383138322d666362372d346533302d386364662d3534323230303437343232363a313330343130303538393531323a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/src1/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:49,556 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src1 2011-04-29 11:09:49,557 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src1 2011-04-29 11:09:49,558 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,119,0 request:: '/hive_zookeeper_namespace/default/src1,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:49,558 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:49,559 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:49,559 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv3.txt' INTO TABLE src1 2011-04-29 11:09:49,560 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:49,560 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv3.txt' INTO TABLE src1 2011-04-29 11:09:49,560 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:49,560 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@src1 2011-04-29 11:09:49,561 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:49,561 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:49,561 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:49,562 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/kv3.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-49_378_482359071233271675/-ext-10000 2011-04-29 11:09:49,605 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/kv3.txt 2011-04-29 11:09:49,775 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.src1 from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-49_378_482359071233271675/-ext-10000 2011-04-29 11:09:49,776 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src1 2011-04-29 11:09:49,796 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src1 { string key, string value} 2011-04-29 11:09:49,796 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@34a45fc1] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:49,943 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src1 2011-04-29 11:09:49,961 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src1 { string key, string value} 2011-04-29 11:09:49,962 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@5f0bebef] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:50,102 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=src1 newtbl=src1 2011-04-29 11:09:50,139 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,140 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv3.txt' INTO TABLE src1 2011-04-29 11:09:50,140 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:50,140 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@src1 2011-04-29 11:09:50,141 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,141 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,141 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:50,142 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,145 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:delete cxid:0x7 zxid:0x78 txntype:2 reqpath:n/a 2011-04-29 11:09:50,145 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:delete cxid:0x7 zxid:0x78 txntype:2 reqpath:n/a 2011-04-29 11:09:50,146 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,120,0 request:: '/hive_zookeeper_namespace/default/src1/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:50,147 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src1 2011-04-29 11:09:50,147 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src1 2011-04-29 11:09:50,148 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,120,0 request:: '/hive_zookeeper_namespace/default/src1,F response:: v{} 2011-04-29 11:09:50,150 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:delete cxid:0x9 zxid:0x79 txntype:2 reqpath:n/a 2011-04-29 11:09:50,150 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:delete cxid:0x9 zxid:0x79 txntype:2 reqpath:n/a 2011-04-29 11:09:50,176 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,121,0 request:: '/hive_zookeeper_namespace/default/src1,-1 response:: null 2011-04-29 11:09:50,178 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:delete cxid:0xa zxid:0x7a txntype:2 reqpath:n/a 2011-04-29 11:09:50,184 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:delete cxid:0xa zxid:0x7a txntype:2 reqpath:n/a 2011-04-29 11:09:50,185 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,122,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:50,186 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:50,186 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:50,187 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,122,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:50,189 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:delete cxid:0xc zxid:0x7b txntype:2 reqpath:n/a 2011-04-29 11:09:50,189 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:delete cxid:0xc zxid:0x7b txntype:2 reqpath:n/a 2011-04-29 11:09:50,190 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,123,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:50,190 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,191 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,191 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.seq' INTO TABLE src_sequencefile 2011-04-29 11:09:50,192 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.seq' INTO TABLE src_sequencefile 2011-04-29 11:09:50,193 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:50,193 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/kv1.seq 2011-04-29 11:09:50,194 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_sequencefile 2011-04-29 11:09:50,208 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_sequencefile { string key, string value} 2011-04-29 11:09:50,208 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@f325905] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:50,244 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_sequencefile { string key, string value} 2011-04-29 11:09:50,245 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:50,246 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:50,246 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,247 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,248 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb000d 2011-04-29 11:09:50,248 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb000d 2011-04-29 11:09:50,251 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb000d 2011-04-29 11:09:50,252 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000d type:closeSession cxid:0xd zxid:0x7c txntype:-11 reqpath:n/a 2011-04-29 11:09:50,253 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000d type:closeSession cxid:0xd zxid:0x7c txntype:-11 reqpath:n/a 2011-04-29 11:09:50,253 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000d, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,124,0 request:: null response:: null 2011-04-29 11:09:50,254 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56318 which had sessionid 0x12fa2738adb000d 2011-04-29 11:09:50,254 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb000d : Unable to read additional data from server sessionid 0x12fa2738adb000d, likely server has closed socket 2011-04-29 11:09:50,254 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb000d 2011-04-29 11:09:50,254 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:50,254 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb000d closed 2011-04-29 11:09:50,256 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@1b416de4 2011-04-29 11:09:50,257 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:50,259 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:50,259 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56319 2011-04-29 11:09:50,259 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:50,261 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56319 client's lastZxid is 0x0 2011-04-29 11:09:50,261 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56319 2011-04-29 11:09:50,262 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:createSession cxid:0x0 zxid:0x7d txntype:-10 reqpath:n/a 2011-04-29 11:09:50,262 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:createSession cxid:0x0 zxid:0x7d txntype:-10 reqpath:n/a 2011-04-29 11:09:50,263 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb000e with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56319 2011-04-29 11:09:50,263 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb000e, negotiated timeout = 40000 2011-04-29 11:09:50,264 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:create cxid:0x1 zxid:0x7e txntype:1 reqpath:n/a 2011-04-29 11:09:50,264 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:create cxid:0x1 zxid:0x7e txntype:1 reqpath:n/a 2011-04-29 11:09:50,265 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,126,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:50,267 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:create cxid:0x2 zxid:0x7f txntype:1 reqpath:n/a 2011-04-29 11:09:50,267 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:create cxid:0x2 zxid:0x7f txntype:1 reqpath:n/a 2011-04-29 11:09:50,268 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,127,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f35396333633436622d346362662d343862392d386238372d6462633838393734306437313a313330343130303539303234373a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:50,268 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:50,268 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:50,269 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,127,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:50,270 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:create cxid:0x4 zxid:0x80 txntype:1 reqpath:n/a 2011-04-29 11:09:50,271 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:create cxid:0x4 zxid:0x80 txntype:1 reqpath:n/a 2011-04-29 11:09:50,271 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,128,0 request:: '/hive_zookeeper_namespace/default/src_sequencefile,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/src_sequencefile 2011-04-29 11:09:50,273 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:create cxid:0x5 zxid:0x81 txntype:1 reqpath:n/a 2011-04-29 11:09:50,273 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:create cxid:0x5 zxid:0x81 txntype:1 reqpath:n/a 2011-04-29 11:09:50,274 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,129,0 request:: '/hive_zookeeper_namespace/default/src_sequencefile/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f35396333633436622d346362662d343862392d386238372d6462633838393734306437313a313330343130303539303234373a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/src_sequencefile/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:50,275 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_sequencefile 2011-04-29 11:09:50,275 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_sequencefile 2011-04-29 11:09:50,276 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,129,0 request:: '/hive_zookeeper_namespace/default/src_sequencefile,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:50,276 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,276 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,276 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.seq' INTO TABLE src_sequencefile 2011-04-29 11:09:50,277 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,277 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.seq' INTO TABLE src_sequencefile 2011-04-29 11:09:50,278 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:50,278 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@src_sequencefile 2011-04-29 11:09:50,278 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,278 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,278 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,279 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/kv1.seq to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-50_192_3507410910402509389/-ext-10000 2011-04-29 11:09:50,316 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/kv1.seq 2011-04-29 11:09:50,429 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.src_sequencefile from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-50_192_3507410910402509389/-ext-10000 2011-04-29 11:09:50,429 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_sequencefile 2011-04-29 11:09:50,448 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_sequencefile { string key, string value} 2011-04-29 11:09:50,449 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@102e6a28] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:50,587 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_sequencefile 2011-04-29 11:09:50,619 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_sequencefile { string key, string value} 2011-04-29 11:09:50,620 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@7d8637cc] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:50,766 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=src_sequencefile newtbl=src_sequencefile 2011-04-29 11:09:50,815 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,815 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/kv1.seq' INTO TABLE src_sequencefile 2011-04-29 11:09:50,815 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:50,816 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@src_sequencefile 2011-04-29 11:09:50,816 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,816 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,817 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:50,817 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,819 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:delete cxid:0x7 zxid:0x82 txntype:2 reqpath:n/a 2011-04-29 11:09:50,819 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:delete cxid:0x7 zxid:0x82 txntype:2 reqpath:n/a 2011-04-29 11:09:50,820 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,130,0 request:: '/hive_zookeeper_namespace/default/src_sequencefile/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:50,821 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_sequencefile 2011-04-29 11:09:50,822 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_sequencefile 2011-04-29 11:09:50,822 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,130,0 request:: '/hive_zookeeper_namespace/default/src_sequencefile,F response:: v{} 2011-04-29 11:09:50,824 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:delete cxid:0x9 zxid:0x83 txntype:2 reqpath:n/a 2011-04-29 11:09:50,824 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:delete cxid:0x9 zxid:0x83 txntype:2 reqpath:n/a 2011-04-29 11:09:50,825 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,131,0 request:: '/hive_zookeeper_namespace/default/src_sequencefile,-1 response:: null 2011-04-29 11:09:50,826 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:delete cxid:0xa zxid:0x84 txntype:2 reqpath:n/a 2011-04-29 11:09:50,826 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:delete cxid:0xa zxid:0x84 txntype:2 reqpath:n/a 2011-04-29 11:09:50,827 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,132,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:50,828 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:50,828 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:50,829 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,132,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:50,830 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:delete cxid:0xc zxid:0x85 txntype:2 reqpath:n/a 2011-04-29 11:09:50,830 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:delete cxid:0xc zxid:0x85 txntype:2 reqpath:n/a 2011-04-29 11:09:50,831 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,133,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:50,831 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,833 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,833 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/complex.seq' INTO TABLE src_thrift 2011-04-29 11:09:50,834 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/complex.seq' INTO TABLE src_thrift 2011-04-29 11:09:50,836 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:50,837 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/complex.seq 2011-04-29 11:09:50,837 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_thrift 2011-04-29 11:09:50,856 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_thrift { } 2011-04-29 11:09:50,897 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_thrift { } 2011-04-29 11:09:50,897 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:50,899 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:50,899 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,899 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,900 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb000e 2011-04-29 11:09:50,900 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb000e 2011-04-29 11:09:50,904 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb000e 2011-04-29 11:09:50,905 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000e type:closeSession cxid:0xd zxid:0x86 txntype:-11 reqpath:n/a 2011-04-29 11:09:50,906 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000e type:closeSession cxid:0xd zxid:0x86 txntype:-11 reqpath:n/a 2011-04-29 11:09:50,912 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000e, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,134,0 request:: null response:: null 2011-04-29 11:09:50,913 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56319 which had sessionid 0x12fa2738adb000e 2011-04-29 11:09:50,913 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb000e : Unable to read additional data from server sessionid 0x12fa2738adb000e, likely server has closed socket 2011-04-29 11:09:50,913 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:50,913 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb000e 2011-04-29 11:09:50,914 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb000e closed 2011-04-29 11:09:50,918 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@4594a0ad 2011-04-29 11:09:50,919 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:50,921 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:50,921 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56320 2011-04-29 11:09:50,922 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:50,922 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56320 client's lastZxid is 0x0 2011-04-29 11:09:50,922 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56320 2011-04-29 11:09:50,923 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:createSession cxid:0x0 zxid:0x87 txntype:-10 reqpath:n/a 2011-04-29 11:09:50,923 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:createSession cxid:0x0 zxid:0x87 txntype:-10 reqpath:n/a 2011-04-29 11:09:50,925 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb000f with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56320 2011-04-29 11:09:50,925 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb000f, negotiated timeout = 40000 2011-04-29 11:09:50,926 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:create cxid:0x1 zxid:0x88 txntype:1 reqpath:n/a 2011-04-29 11:09:50,927 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:create cxid:0x1 zxid:0x88 txntype:1 reqpath:n/a 2011-04-29 11:09:50,927 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,136,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:50,929 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:create cxid:0x2 zxid:0x89 txntype:1 reqpath:n/a 2011-04-29 11:09:50,930 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:create cxid:0x2 zxid:0x89 txntype:1 reqpath:n/a 2011-04-29 11:09:50,930 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,137,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f64303763343261372d653830662d346239652d626536392d3565393536633030656430333a313330343130303539303839393a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:50,931 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:50,931 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:50,932 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,137,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:50,943 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:create cxid:0x4 zxid:0x8a txntype:1 reqpath:n/a 2011-04-29 11:09:50,943 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:create cxid:0x4 zxid:0x8a txntype:1 reqpath:n/a 2011-04-29 11:09:50,944 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,138,0 request:: '/hive_zookeeper_namespace/default/src_thrift,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/src_thrift 2011-04-29 11:09:50,945 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:create cxid:0x5 zxid:0x8b txntype:1 reqpath:n/a 2011-04-29 11:09:50,946 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:create cxid:0x5 zxid:0x8b txntype:1 reqpath:n/a 2011-04-29 11:09:50,947 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,139,0 request:: '/hive_zookeeper_namespace/default/src_thrift/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f64303763343261372d653830662d346239652d626536392d3565393536633030656430333a313330343130303539303839393a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/src_thrift/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:50,947 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_thrift 2011-04-29 11:09:50,948 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_thrift 2011-04-29 11:09:50,948 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,139,0 request:: '/hive_zookeeper_namespace/default/src_thrift,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:50,949 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,949 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,949 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/complex.seq' INTO TABLE src_thrift 2011-04-29 11:09:50,951 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,952 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/complex.seq' INTO TABLE src_thrift 2011-04-29 11:09:50,952 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:50,952 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@src_thrift 2011-04-29 11:09:50,952 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,952 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:50,953 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:50,954 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/complex.seq to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-50_834_3061034869386920337/-ext-10000 2011-04-29 11:09:50,994 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/complex.seq 2011-04-29 11:09:51,104 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.src_thrift from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-50_834_3061034869386920337/-ext-10000 2011-04-29 11:09:51,105 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_thrift 2011-04-29 11:09:51,123 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_thrift { } 2011-04-29 11:09:51,236 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_thrift 2011-04-29 11:09:51,270 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_thrift { } 2011-04-29 11:09:51,414 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=src_thrift newtbl=src_thrift 2011-04-29 11:09:51,460 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:51,461 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/complex.seq' INTO TABLE src_thrift 2011-04-29 11:09:51,461 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:51,461 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@src_thrift 2011-04-29 11:09:51,461 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:51,462 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:51,462 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:51,462 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:51,465 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:delete cxid:0x7 zxid:0x8c txntype:2 reqpath:n/a 2011-04-29 11:09:51,465 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:delete cxid:0x7 zxid:0x8c txntype:2 reqpath:n/a 2011-04-29 11:09:51,466 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,140,0 request:: '/hive_zookeeper_namespace/default/src_thrift/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:51,467 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_thrift 2011-04-29 11:09:51,467 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_thrift 2011-04-29 11:09:51,468 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,140,0 request:: '/hive_zookeeper_namespace/default/src_thrift,F response:: v{} 2011-04-29 11:09:51,469 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:delete cxid:0x9 zxid:0x8d txntype:2 reqpath:n/a 2011-04-29 11:09:51,470 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:delete cxid:0x9 zxid:0x8d txntype:2 reqpath:n/a 2011-04-29 11:09:51,470 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,141,0 request:: '/hive_zookeeper_namespace/default/src_thrift,-1 response:: null 2011-04-29 11:09:51,472 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:delete cxid:0xa zxid:0x8e txntype:2 reqpath:n/a 2011-04-29 11:09:51,472 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:delete cxid:0xa zxid:0x8e txntype:2 reqpath:n/a 2011-04-29 11:09:51,473 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,142,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:51,473 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:51,473 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:51,474 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,142,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:51,477 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:delete cxid:0xc zxid:0x8f txntype:2 reqpath:n/a 2011-04-29 11:09:51,478 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:delete cxid:0xc zxid:0x8f txntype:2 reqpath:n/a 2011-04-29 11:09:51,478 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,143,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:51,479 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:51,479 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:51,480 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/json.txt' INTO TABLE src_json 2011-04-29 11:09:51,480 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/json.txt' INTO TABLE src_json 2011-04-29 11:09:51,481 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:51,482 DEBUG parse.LoadSemanticAnalyzer (LoadSemanticAnalyzer.java:initializeFromURI(109)) - file@null@/Users/rmelick/hive/data/files/json.txt 2011-04-29 11:09:51,482 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_json 2011-04-29 11:09:51,496 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_json { string json} 2011-04-29 11:09:51,497 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[json] columnTypes=[string] separator=[[B@21712712] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:51,534 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_json { string json} 2011-04-29 11:09:51,535 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:51,536 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:51,536 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:51,536 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:51,537 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb000f 2011-04-29 11:09:51,537 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb000f 2011-04-29 11:09:51,541 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb000f 2011-04-29 11:09:51,542 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb000f type:closeSession cxid:0xd zxid:0x90 txntype:-11 reqpath:n/a 2011-04-29 11:09:51,543 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb000f type:closeSession cxid:0xd zxid:0x90 txntype:-11 reqpath:n/a 2011-04-29 11:09:51,544 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb000f, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,144,0 request:: null response:: null 2011-04-29 11:09:51,544 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56320 which had sessionid 0x12fa2738adb000f 2011-04-29 11:09:51,544 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb000f 2011-04-29 11:09:51,544 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb000f : Unable to read additional data from server sessionid 0x12fa2738adb000f, likely server has closed socket 2011-04-29 11:09:51,545 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb000f closed 2011-04-29 11:09:51,545 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:51,545 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@32a6cf28 2011-04-29 11:09:51,546 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:09:51,547 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /0:0:0:0:0:0:0:1%0:56321 2011-04-29 11:09:51,548 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/0:0:0:0:0:0:0:1:21818, initiating session 2011-04-29 11:09:51,548 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:09:51,548 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /0:0:0:0:0:0:0:1%0:56321 client's lastZxid is 0x0 2011-04-29 11:09:51,549 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /0:0:0:0:0:0:0:1%0:56321 2011-04-29 11:09:51,551 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:createSession cxid:0x0 zxid:0x91 txntype:-10 reqpath:n/a 2011-04-29 11:09:51,551 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:createSession cxid:0x0 zxid:0x91 txntype:-10 reqpath:n/a 2011-04-29 11:09:51,552 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0010 with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1%0:56321 2011-04-29 11:09:51,552 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21818, sessionid = 0x12fa2738adb0010, negotiated timeout = 40000 2011-04-29 11:09:51,563 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:create cxid:0x1 zxid:0x92 txntype:1 reqpath:n/a 2011-04-29 11:09:51,564 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:create cxid:0x1 zxid:0x92 txntype:1 reqpath:n/a 2011-04-29 11:09:51,564 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,146,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:51,566 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:create cxid:0x2 zxid:0x93 txntype:1 reqpath:n/a 2011-04-29 11:09:51,567 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:create cxid:0x2 zxid:0x93 txntype:1 reqpath:n/a 2011-04-29 11:09:51,568 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,147,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f35303237643430332d663335352d343662622d613465302d6361343735386131316431373a313330343130303539313533363a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:51,568 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:51,569 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:51,569 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,147,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:51,571 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:create cxid:0x4 zxid:0x94 txntype:1 reqpath:n/a 2011-04-29 11:09:51,571 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:create cxid:0x4 zxid:0x94 txntype:1 reqpath:n/a 2011-04-29 11:09:51,572 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,148,0 request:: '/hive_zookeeper_namespace/default/src_json,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/src_json 2011-04-29 11:09:51,574 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:create cxid:0x5 zxid:0x95 txntype:1 reqpath:n/a 2011-04-29 11:09:51,574 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:create cxid:0x5 zxid:0x95 txntype:1 reqpath:n/a 2011-04-29 11:09:51,575 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,149,0 request:: '/hive_zookeeper_namespace/default/src_json/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f35303237643430332d663335352d343662622d613465302d6361343735386131316431373a313330343130303539313533363a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/src_json/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:51,576 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_json 2011-04-29 11:09:51,576 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_json 2011-04-29 11:09:51,577 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,149,0 request:: '/hive_zookeeper_namespace/default/src_json,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:51,577 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:51,577 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:51,578 INFO ql.Driver (Driver.java:execute(972)) - Starting command: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/json.txt' INTO TABLE src_json 2011-04-29 11:09:51,578 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:51,579 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/json.txt' INTO TABLE src_json 2011-04-29 11:09:51,579 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: LOAD 2011-04-29 11:09:51,579 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@src_json 2011-04-29 11:09:51,579 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:51,579 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:51,580 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:51,580 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Copying data from file:/Users/rmelick/hive/data/files/json.txt to pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-51_480_9067297592539511918/-ext-10000 2011-04-29 11:09:51,617 DEBUG exec.MoveTask (CopyTask.java:execute(78)) - Copying file: file:/Users/rmelick/hive/data/files/json.txt 2011-04-29 11:09:51,730 INFO exec.MoveTask (SessionState.java:printInfo(365)) - Loading data to table default.src_json from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-51_480_9067297592539511918/-ext-10000 2011-04-29 11:09:51,731 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_json 2011-04-29 11:09:51,752 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_json { string json} 2011-04-29 11:09:51,753 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[json] columnTypes=[string] separator=[[B@4741e072] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:51,897 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_json 2011-04-29 11:09:51,915 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src_json { string json} 2011-04-29 11:09:51,916 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[json] columnTypes=[string] separator=[[B@13d97585] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:52,055 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=src_json newtbl=src_json 2011-04-29 11:09:52,090 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,091 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: LOAD DATA LOCAL INPATH '/Users/rmelick/hive/data/files/json.txt' INTO TABLE src_json 2011-04-29 11:09:52,091 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: LOAD 2011-04-29 11:09:52,091 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@src_json 2011-04-29 11:09:52,092 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,092 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,092 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:52,092 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,095 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:delete cxid:0x7 zxid:0x96 txntype:2 reqpath:n/a 2011-04-29 11:09:52,095 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:delete cxid:0x7 zxid:0x96 txntype:2 reqpath:n/a 2011-04-29 11:09:52,096 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,150,0 request:: '/hive_zookeeper_namespace/default/src_json/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:52,096 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_json 2011-04-29 11:09:52,096 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src_json 2011-04-29 11:09:52,097 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,150,0 request:: '/hive_zookeeper_namespace/default/src_json,F response:: v{} 2011-04-29 11:09:52,098 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:delete cxid:0x9 zxid:0x97 txntype:2 reqpath:n/a 2011-04-29 11:09:52,098 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:delete cxid:0x9 zxid:0x97 txntype:2 reqpath:n/a 2011-04-29 11:09:52,099 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,151,0 request:: '/hive_zookeeper_namespace/default/src_json,-1 response:: null 2011-04-29 11:09:52,100 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:delete cxid:0xa zxid:0x98 txntype:2 reqpath:n/a 2011-04-29 11:09:52,100 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:delete cxid:0xa zxid:0x98 txntype:2 reqpath:n/a 2011-04-29 11:09:52,101 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,152,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:52,101 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:52,102 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:52,102 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,152,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:52,103 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:delete cxid:0xc zxid:0x99 txntype:2 reqpath:n/a 2011-04-29 11:09:52,104 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:delete cxid:0xc zxid:0x99 txntype:2 reqpath:n/a 2011-04-29 11:09:52,104 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0010, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,153,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:52,104 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,124 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_all_databases 2011-04-29 11:09:52,153 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_tables: db=default pat=.* 2011-04-29 11:09:52,167 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src 2011-04-29 11:09:52,167 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:09:52,373 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:09:52,374 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:09:52,374 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src1 2011-04-29 11:09:52,374 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:09:52,377 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:09:52,377 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:09:52,377 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src_json 2011-04-29 11:09:52,378 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:09:52,380 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:09:52,380 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:09:52,380 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src_sequencefile 2011-04-29 11:09:52,380 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:09:52,391 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:09:52,392 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:09:52,392 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src_thrift 2011-04-29 11:09:52,392 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:09:52,394 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:09:52,394 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:09:52,395 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=srcbucket 2011-04-29 11:09:52,395 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:09:52,397 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:09:52,397 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:09:52,398 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=srcbucket2 2011-04-29 11:09:52,398 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:09:52,400 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:09:52,400 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:09:52,400 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=srcpart 2011-04-29 11:09:52,401 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:09:52,402 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:09:52,403 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:09:52,403 DEBUG metastore.ObjectStore (ObjectStore.java:listRoleNames(2044)) - Executing listAllRoleNames 2011-04-29 11:09:52,481 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0000 2011-04-29 11:09:52,481 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0000 2011-04-29 11:09:52,481 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0000 2011-04-29 11:09:52,483 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0000 type:closeSession cxid:0x1 zxid:0x9a txntype:-11 reqpath:n/a 2011-04-29 11:09:52,483 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0000 type:closeSession cxid:0x1 zxid:0x9a txntype:-11 reqpath:n/a 2011-04-29 11:09:52,484 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0000, packet:: clientPath:null serverPath:null finished:false header:: 1,-11 replyHeader:: 1,154,0 request:: null response:: null 2011-04-29 11:09:52,484 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0000 2011-04-29 11:09:52,484 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56305 which had sessionid 0x12fa2738adb0000 2011-04-29 11:09:52,484 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1458)) - ignoring exception during input shutdown java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.server.NIOServerCnxn.closeSock(NIOServerCnxn.java:1454) at org.apache.zookeeper.server.NIOServerCnxn.close(NIOServerCnxn.java:1411) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:631) at org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:261) 2011-04-29 11:09:52,484 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0000 closed 2011-04-29 11:09:52,485 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=null 2011-04-29 11:09:52,485 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:52,487 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:21818, initiating session 2011-04-29 11:09:52,488 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:21818 2011-04-29 11:09:52,487 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:56322 2011-04-29 11:09:52,488 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /fe80:0:0:0:0:0:0:1%1:56322 client's lastZxid is 0x0 2011-04-29 11:09:52,489 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:56322 2011-04-29 11:09:52,508 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0011 type:createSession cxid:0x0 zxid:0x9b txntype:-10 reqpath:n/a 2011-04-29 11:09:52,508 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0011 type:createSession cxid:0x0 zxid:0x9b txntype:-10 reqpath:n/a 2011-04-29 11:09:52,509 INFO exec.HiveHistory (SessionState.java:printInfo(365)) - Hive history file=/Users/rmelick/hive/build/ql/tmp/hive_job_log_rmelick_201104291109_1624187859.txt 2011-04-29 11:09:52,510 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0011 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:56322 2011-04-29 11:09:52,510 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:21818, sessionid = 0x12fa2738adb0011, negotiated timeout = 40000 2011-04-29 11:09:52,511 ERROR zookeeper.ClientCnxn (ClientCnxn.java:run(490)) - Error while calling watcher java.lang.NullPointerException at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:488) 2011-04-29 11:09:52,602 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,603 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: -- Test if index is actually being used. -- Create temp, and populate it with some values in src. CREATE TABLE temp(key STRING, val STRING) STORED AS TEXTFILE 2011-04-29 11:09:52,606 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: -- Test if index is actually being used. -- Create temp, and populate it with some values in src. CREATE TABLE temp(key STRING, val STRING) STORED AS TEXTFILE 2011-04-29 11:09:52,607 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:52,607 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:09:52,608 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeCreateTable(7228)) - Creating table temp position=13 2011-04-29 11:09:52,608 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:52,608 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:52,609 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,609 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@4f2f2b9e 2011-04-29 11:09:52,610 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:09:52,610 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56323 2011-04-29 11:09:52,611 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:09:52,611 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:09:52,611 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56323 client's lastZxid is 0x0 2011-04-29 11:09:52,612 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56323 2011-04-29 11:09:52,612 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0012 type:createSession cxid:0x0 zxid:0x9c txntype:-10 reqpath:n/a 2011-04-29 11:09:52,613 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0012 type:createSession cxid:0x0 zxid:0x9c txntype:-10 reqpath:n/a 2011-04-29 11:09:52,613 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0012 with negotiated timeout 40000 for client /127.0.0.1:56323 2011-04-29 11:09:52,614 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb0012, negotiated timeout = 40000 2011-04-29 11:09:52,616 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(405)) - Got user-level KeeperException when processing sessionid:0x12fa2738adb0012 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hive_zookeeper_namespace Error:KeeperErrorCode = NodeExists for /hive_zookeeper_namespace 2011-04-29 11:09:52,617 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0012 type:create cxid:0x1 zxid:0x9d txntype:-1 reqpath:n/a 2011-04-29 11:09:52,618 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0012, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,157,-110 request:: '/hive_zookeeper_namespace,,v{s{31,s{'world,'anyone}}},0 response:: 2011-04-29 11:09:52,618 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,619 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,619 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,619 INFO ql.Driver (Driver.java:execute(972)) - Starting command: -- Test if index is actually being used. -- Create temp, and populate it with some values in src. CREATE TABLE temp(key STRING, val STRING) STORED AS TEXTFILE 2011-04-29 11:09:52,619 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,620 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: -- Test if index is actually being used. -- Create temp, and populate it with some values in src. CREATE TABLE temp(key STRING, val STRING) STORED AS TEXTFILE 2011-04-29 11:09:52,620 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: CREATETABLE 2011-04-29 11:09:52,620 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,620 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,620 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,621 INFO exec.DDLTask (DDLTask.java:createTable(3109)) - Default to LazySimpleSerDe for table temp 2011-04-29 11:09:52,621 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:52,622 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@23597cac] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:52,622 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=temp 2011-04-29 11:09:52,639 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp 2011-04-29 11:09:52,736 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,737 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: -- Test if index is actually being used. -- Create temp, and populate it with some values in src. CREATE TABLE temp(key STRING, val STRING) STORED AS TEXTFILE 2011-04-29 11:09:52,737 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: CREATETABLE 2011-04-29 11:09:52,737 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@temp 2011-04-29 11:09:52,738 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,738 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,738 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:52,738 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,739 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:52,739 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 0.137 seconds 2011-04-29 11:09:52,739 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:52,740 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: INSERT OVERWRITE TABLE temp SELECT * FROM src WHERE key < 50 2011-04-29 11:09:52,741 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: INSERT OVERWRITE TABLE temp SELECT * FROM src WHERE key < 50 2011-04-29 11:09:52,775 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:52,776 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:09:52,777 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6792)) - Completed phase 1 of Semantic Analysis 2011-04-29 11:09:52,777 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(816)) - Get metadata for source tables 2011-04-29 11:09:52,778 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src 2011-04-29 11:09:52,831 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:52,831 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@32079df9] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:52,832 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(877)) - Get metadata for subqueries 2011-04-29 11:09:52,832 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(884)) - Get metadata for destination tables 2011-04-29 11:09:52,832 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:09:52,849 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:52,849 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@1fc1b26c] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:52,850 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6795)) - Completed getting MetaData in Semantic Analysis 2011-04-29 11:09:52,880 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(5962)) - Created Table Plan for src org.apache.hadoop.hive.ql.exec.TableScanOperator@3f2b3cc4 2011-04-29 11:09:52,902 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFilterPlan(1403)) - Created Filter Plan for null row schema: src{(key,key: string)(value,value: string)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:09:52,902 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1933)) - tree: (TOK_SELECT (TOK_SELEXPR TOK_ALLCOLREF)) 2011-04-29 11:09:52,902 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2034)) - genSelectPlan: input = src{(key,key: string)(value,value: string)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:09:52,904 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2151)) - Created Select Plan row schema: src{(key,_col0: string)(value,_col1: string)} 2011-04-29 11:09:52,904 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1922)) - Created Select Plan for clause: insclause-0 2011-04-29 11:09:52,933 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:52,935 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@64b045f4] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:52,936 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@70c0c9d0] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:52,940 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(3877)) - Created FileSink Plan for clause: insclause-0dest_path: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp row schema: src{(key,_col0: string)(value,_col1: string)} 2011-04-29 11:09:52,941 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(5560)) - Created Body Plan for Query Block null 2011-04-29 11:09:52,941 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(6079)) - Created Plan for Query Block null 2011-04-29 11:09:52,981 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for FS(3) 2011-04-29 11:09:52,981 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(2) 2011-04-29 11:09:52,982 INFO ppd.OpProcFactory (OpProcFactory.java:process(144)) - Processing for FIL(1) 2011-04-29 11:09:52,987 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of FIL For Alias : src 2011-04-29 11:09:52,987 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - (key < 50) 2011-04-29 11:09:52,987 INFO ppd.OpProcFactory (OpProcFactory.java:process(124)) - Processing for TS(0) 2011-04-29 11:09:52,988 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of TS For Alias : src 2011-04-29 11:09:52,988 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - (key < 50) 2011-04-29 11:09:52,997 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(168)) - Started pruning partiton 2011-04-29 11:09:52,998 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(169)) - dbname = default 2011-04-29 11:09:52,998 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(170)) - tabname = src 2011-04-29 11:09:52,998 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(171)) - prune Expression = Const boolean null 2011-04-29 11:09:53,050 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:53,051 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:53,051 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@51d9d305] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:53,053 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:09:53,053 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(692)) - Adding pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src of tablesrc 2011-04-29 11:09:53,053 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(725)) - Information added for path pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src 2011-04-29 11:09:53,060 INFO optimizer.GenMRFileSink1 (GenMRFileSink1.java:createMergeJob(279)) - use CombineHiveInputformat for the merge job 2011-04-29 11:09:53,066 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6833)) - Completed plan generation 2011-04-29 11:09:53,066 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:53,068 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:key, type:string, comment:null), FieldSchema(name:value, type:string, comment:null)], properties:null) 2011-04-29 11:09:53,068 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:53,069 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:53,069 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0012 2011-04-29 11:09:53,081 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0012 2011-04-29 11:09:53,082 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0012 2011-04-29 11:09:53,083 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0012 type:closeSession cxid:0x2 zxid:0x9e txntype:-11 reqpath:n/a 2011-04-29 11:09:53,083 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0012 type:closeSession cxid:0x2 zxid:0x9e txntype:-11 reqpath:n/a 2011-04-29 11:09:53,084 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0012, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,158,0 request:: null response:: null 2011-04-29 11:09:53,084 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56323 which had sessionid 0x12fa2738adb0012 2011-04-29 11:09:53,084 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0012 2011-04-29 11:09:53,085 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0012 : Unable to read additional data from server sessionid 0x12fa2738adb0012, likely server has closed socket 2011-04-29 11:09:53,085 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0012 closed 2011-04-29 11:09:53,087 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:09:53,087 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@11e61e14 2011-04-29 11:09:53,088 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:09:53,089 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/0:0:0:0:0:0:0:1:21818, initiating session 2011-04-29 11:09:53,089 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /0:0:0:0:0:0:0:1%0:56324 2011-04-29 11:09:53,089 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:09:53,089 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /0:0:0:0:0:0:0:1%0:56324 client's lastZxid is 0x0 2011-04-29 11:09:53,090 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /0:0:0:0:0:0:0:1%0:56324 2011-04-29 11:09:53,091 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:createSession cxid:0x0 zxid:0x9f txntype:-10 reqpath:n/a 2011-04-29 11:09:53,091 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:createSession cxid:0x0 zxid:0x9f txntype:-10 reqpath:n/a 2011-04-29 11:09:53,092 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0013 with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1%0:56324 2011-04-29 11:09:53,092 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21818, sessionid = 0x12fa2738adb0013, negotiated timeout = 40000 2011-04-29 11:09:53,093 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:create cxid:0x1 zxid:0xa0 txntype:1 reqpath:n/a 2011-04-29 11:09:53,093 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:create cxid:0x1 zxid:0xa0 txntype:1 reqpath:n/a 2011-04-29 11:09:53,094 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,160,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:09:53,096 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:create cxid:0x2 zxid:0xa1 txntype:1 reqpath:n/a 2011-04-29 11:09:53,096 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:create cxid:0x2 zxid:0xa1 txntype:1 reqpath:n/a 2011-04-29 11:09:53,097 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,161,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f37353630303130312d333839362d343938382d396161662d3933356237666431666331383a313330343130303539333036393a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:09:53,097 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:53,098 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:53,098 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,161,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:53,100 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:create cxid:0x4 zxid:0xa2 txntype:1 reqpath:n/a 2011-04-29 11:09:53,100 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:create cxid:0x4 zxid:0xa2 txntype:1 reqpath:n/a 2011-04-29 11:09:53,101 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,162,0 request:: '/hive_zookeeper_namespace/default/src,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/src 2011-04-29 11:09:53,102 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:create cxid:0x5 zxid:0xa3 txntype:1 reqpath:n/a 2011-04-29 11:09:53,103 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:create cxid:0x5 zxid:0xa3 txntype:1 reqpath:n/a 2011-04-29 11:09:53,103 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,163,0 request:: '/hive_zookeeper_namespace/default/src/LOCK-SHARED-,#726d656c69636b5f32303131303432393131303930395f37353630303130312d333839362d343938382d396161662d3933356237666431666331383a313330343130303539333036393a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/src/LOCK-SHARED-0000000000 2011-04-29 11:09:53,104 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:09:53,104 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:09:53,105 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,163,0 request:: '/hive_zookeeper_namespace/default/src,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:09:53,106 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:create cxid:0x7 zxid:0xa4 txntype:1 reqpath:n/a 2011-04-29 11:09:53,106 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:create cxid:0x7 zxid:0xa4 txntype:1 reqpath:n/a 2011-04-29 11:09:53,107 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 7,1 replyHeader:: 7,164,0 request:: '/hive_zookeeper_namespace/default/temp,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/temp 2011-04-29 11:09:53,108 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:create cxid:0x8 zxid:0xa5 txntype:1 reqpath:n/a 2011-04-29 11:09:53,108 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:create cxid:0x8 zxid:0xa5 txntype:1 reqpath:n/a 2011-04-29 11:09:53,109 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 8,1 replyHeader:: 8,165,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131303930395f37353630303130312d333839362d343938382d396161662d3933356237666431666331383a313330343130303539333036393a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:09:53,109 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:getChildren cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:09:53,110 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:getChildren cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:09:53,110 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 9,8 replyHeader:: 9,165,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:09:53,111 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:53,111 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:53,111 INFO ql.Driver (Driver.java:execute(972)) - Starting command: INSERT OVERWRITE TABLE temp SELECT * FROM src WHERE key < 50 2011-04-29 11:09:53,116 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:53,116 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: INSERT OVERWRITE TABLE temp SELECT * FROM src WHERE key < 50 2011-04-29 11:09:53,117 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: QUERY 2011-04-29 11:09:53,117 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Input: default@src 2011-04-29 11:09:53,117 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@temp 2011-04-29 11:09:53,117 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:53,118 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:53,118 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:53,118 INFO ql.Driver (SessionState.java:printInfo(365)) - Total MapReduce jobs = 2 2011-04-29 11:09:53,119 INFO ql.Driver (SessionState.java:printInfo(365)) - Launching Job 1 out of 2 2011-04-29 11:09:53,125 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Number of reduce tasks is set to 0 since there's no reduce operator 2011-04-29 11:09:53,162 INFO exec.ConditionalTask (MapRedTask.java:execute(161)) - Generating plan file file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-09-52_740_3043453006429688721/-local-10003/plan.xml 2011-04-29 11:09:53,406 INFO exec.ConditionalTask (MapRedTask.java:execute(198)) - Executing: /Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/bin/hadoop jar /Users/rmelick/hive/build/ql/hive-exec-0.8.0-SNAPSHOT.jar org.apache.hadoop.hive.ql.exec.ExecDriver -libjars file:///Users/rmelick/hive/build/ql/test/test-udfs.jar -plan file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-09-52_740_3043453006429688721/-local-10003/plan.xml -nolog -jobconf hive.stats.jdbcdriver=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.aux.jars.path=file%3A%2F%2F%2FUsers%2Frmelick%2Fhive%2Fbuild%2Fql%2Ftest%2Ftest-udfs.jar -jobconf hive.mapjoin.followby.gby.localtask.max.memory.usage=0.55 -jobconf hive.limit.optimize.limit.file=10 -jobconf datanucleus.validateColumns=false -jobconf datanucleus.connectionPoolingType=DBCP -jobconf hadoop.tmp.dir=%24%7Bbuild.dir.hive%7D%2Ftest%2Fhadoop-%24%7Buser.name%7D -jobconf test.src.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Fsrc%2Ftest -jobconf hive.variable.substitute=true -jobconf hive.stats.dbclass=jdbc%3Aderby -jobconf hive.lock.mapred.only.operation=false -jobconf hive.script.serde=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe -jobconf hive.merge.smallfiles.avgsize=16000000 -jobconf datanucleus.cache.level2=false -jobconf hive.hbase.wal.enabled=true -jobconf hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider -jobconf hive.metastore.rawstore.impl=org.apache.hadoop.hive.metastore.ObjectStore -jobconf hive.metastore.local=true -jobconf hive.optimize.ppd.storage=true -jobconf hive.querylog.location=%24%7Bbuild.dir%7D%2Ftmp -jobconf hive.limit.row.max.size=100000 -jobconf hive.rework.mapredwork=false -jobconf hive.added.jars.path= -jobconf hive.metastore.authorization.storage.checks=false -jobconf hive.zookeeper.namespace=hive_zookeeper_namespace -jobconf hive.test.mode.prefix=test_ -jobconf hive.test.mode=false -jobconf hive.exec.compress.intermediate=false -jobconf datanucleus.cache.level2.type=SOFT -jobconf hive.metastore.ds.retry.attempts=1 -jobconf hive.limit.optimize.enable=false -jobconf hive.zookeeper.client.port=21818 -jobconf javax.jdo.option.ConnectionUserName=APP -jobconf hive.merge.mapfiles=true -jobconf hive.test.mode.samplefreq=32 -jobconf hive.optimize.skewjoin=false -jobconf hive.metastore.server.min.threads=200 -jobconf hive.mapjoin.localtask.max.memory.usage=0.90 -jobconf hive.map.aggr.hash.min.reduction=0.5 -jobconf hive.exec.compress.output=false -jobconf hive.script.recordreader=org.apache.hadoop.hive.ql.exec.TextRecordReader -jobconf javax.jdo.option.Multithreaded=true -jobconf hive.exec.post.hooks=org.apache.hadoop.hive.ql.hooks.PostExecutePrinter -jobconf hive.lock.numretries=100 -jobconf hive.exec.parallel.thread.number=8 -jobconf hive.exec.max.created.files=100000 -jobconf hive.exec.default.partition.name=__HIVE_DEFAULT_PARTITION__ -jobconf test.log.dir=%24%7Bbuild.dir%7D%2Ftest%2Flogs -jobconf hive.archive.har.parentdir.settable=false -jobconf hive.exec.pre.hooks=org.apache.hadoop.hive.ql.hooks.PreExecutePrinter%2C+org.apache.hadoop.hive.ql.hooks.EnforceReadOnlyTables -jobconf hive.exec.mode.local.auto=false -jobconf hive.optimize.index.filter=false -jobconf datanucleus.storeManagerType=rdbms -jobconf hive.script.operator.id.env.var=HIVE_SCRIPT_OPERATOR_ID -jobconf hive.metastore.ds.retry.interval=1000 -jobconf hive.skewjoin.mapjoin.min.split=33554432 -jobconf hive.metastore.client.connect.retry.delay=1 -jobconf hive.auto.convert.join=false -jobconf hive.metastore.warehouse.dir=%24%7Btest.warehouse.dir%7D -jobconf hive.mapjoin.bucket.cache.size=100 -jobconf datanucleus.transactionIsolation=read-committed -jobconf hive.stats.jdbc.timeout=30 -jobconf hive.concurrency.manager=org.apache.hadoop.hive.ql.lockmgr.ZooKeeperLockMgr -jobconf hive.mergejob.maponly=true -jobconf hive.fetch.output.serde=org.apache.hadoop.hive.serde2.DelimitedJSONSerDe -jobconf hive.mapjoin.followby.map.aggr.hash.percentmemory=0.3 -jobconf hive.exim.uri.scheme.whitelist=hdfs%2Cpfile -jobconf hive.stats.dbconnectionstring=jdbc%3Aderby%3A%3BdatabaseName%3DTempStatsStore%3Bcreate%3Dtrue -jobconf mapred.reduce.tasks=-1 -jobconf hive.optimize.index.filter.compact.minsize=5368709120 -jobconf hive.skewjoin.key=100000 -jobconf javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.DummyAuthenticator -jobconf hive.udtf.auto.progress=false -jobconf hive.session.id=rmelick_201104291109 -jobconf mapred.job.name=INSERT+OVERWRITE+TABLE+temp+SELECT+*+FR...50%28Stage-1%29 -jobconf hive.exec.script.maxerrsize=100000 -jobconf hive.optimize.groupby=true -jobconf datanucleus.plugin.pluginRegistryBundleCheck=LOG -jobconf hive.exec.rowoffset=false -jobconf hive.default.fileformat=TextFile -jobconf hive.mapjoin.smalltable.filesize=25000000 -jobconf hive.exec.scratchdir=%24%7Bbuild.dir%7D%2Fscratchdir -jobconf datanucleus.identifierFactory=datanucleus -jobconf hive.exec.max.dynamic.partitions.pernode=100 -jobconf hive.join.emit.interval=1000 -jobconf hive.script.recordwriter=org.apache.hadoop.hive.ql.exec.TextRecordWriter -jobconf datanucleus.validateConstraints=false -jobconf hive.exec.dynamic.partition=false -jobconf hive.optimize.index.filter.compact.maxsize=-1 -jobconf hive.metastore.client.socket.timeout=20 -jobconf hive.map.aggr.hash.force.flush.memory.threshold=0.9 -jobconf hive.exec.show.job.failure.debug.info=false -jobconf hive.join.cache.size=25000 -jobconf datanucleus.autoStartMechanismMode=checked -jobconf hive.input.format=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat -jobconf hive.skewjoin.mapjoin.map.tasks=10000 -jobconf hive.exec.drop.ignorenonexistent=true -jobconf hive.hwi.listen.port=9999 -jobconf hive.session.silent=true -jobconf hive.cli.print.header=false -jobconf hive.groupby.mapaggr.checkinterval=100000 -jobconf hive.metastore.server.max.threads=100000 -jobconf hive.metastore.kerberos.principal=hive-metastore%2F_HOST%40EXAMPLE.COM -jobconf javax.jdo.option.ConnectionURL=jdbc%3Aderby%3A%3BdatabaseName%3D..%2Fbuild%2Ftest%2Fjunit_metastore_db%3Bcreate%3Dtrue -jobconf hive.mapred.mode=nonstrict -jobconf hive.metastore.batch.retrieve.max=300 -jobconf hive.groupby.skewindata=false -jobconf hive.exec.parallel=false -jobconf hive.zookeeper.clean.extra.nodes=false -jobconf test.data.files=%24%7Buser.dir%7D%2F..%2Fdata%2Ffiles -jobconf hive.merge.size.per.task=256000000 -jobconf fs.har.impl=org.apache.hadoop.hive.shims.HiveHarFileSystem -jobconf hive.exec.reducers.max=999 -jobconf fs.pfile.impl=org.apache.hadoop.fs.ProxyLocalFileSystem -jobconf hive.query.string=%0AINSERT+OVERWRITE+TABLE+temp+SELECT+*+FROM+src+WHERE+key+%3C+50 -jobconf hive.optimize.ppd=true -jobconf hive.metastore.cache.pinobjtypes=Table%2CStorageDescriptor%2CSerDeInfo%2CPartition%2CDatabase%2CType%2CFieldSchema%2COrder -jobconf hive.mapjoin.hashtable.initialCapacity=100000 -jobconf hive.jar.path=%24%7Bbuild.dir.hive%7D%2Fql%2Fhive-exec-%24%7Bversion%7D.jar -jobconf hive.mapjoin.cache.numrows=25000 -jobconf hive.merge.mapredfiles=false -jobconf hive.metastore.sasl.enabled=false -jobconf hive.fileformat.check=true -jobconf hive.metastore.connect.retries=5 -jobconf hive.query.id=rmelick_20110429110909_75600101-3896-4988-9aaf-935b7fd1fc18 -jobconf hive.zookeeper.quorum=localhost -jobconf javax.jdo.option.DetachAllOnCommit=true -jobconf hive.metastore.metadb.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Ftest%2Fdata%2Fmetadb%2F -jobconf javax.jdo.option.ConnectionPassword=mine -jobconf hive.optimize.pruner=true -jobconf hive.optimize.reducededuplication=true -jobconf hive.hwi.listen.host=0.0.0.0 -jobconf hive.index.compact.file.ignore.hdfs=false -jobconf hive.auto.progress.timeout=0 -jobconf hive.map.aggr.hash.percentmemory=0.5 -jobconf hive.mapjoin.check.memory.rows=100000 -jobconf javax.jdo.PersistenceManagerFactoryClass=org.datanucleus.jdo.JDOPersistenceManagerFactory -jobconf hive.mapred.local.mem=0 -jobconf datanucleus.validateTables=false -jobconf hive.exec.max.dynamic.partitions=1000 -jobconf hive.stats.jdbc.atomic=false -jobconf hive.exec.dynamic.partition.mode=strict -jobconf hive.hwi.war.file=lib%2Fhive-hwi-%40VERSION%40.war -jobconf hive.script.auto.progress=false -jobconf hive.lock.sleep.between.retries=60 -jobconf hive.enforce.sorting=false -jobconf datanucleus.autoCreateSchema=true -jobconf hive.task.progress=false -jobconf hive.metastore.server.tcp.keepalive=true -jobconf hive.stats.autogather=true -jobconf hive.map.aggr=true -jobconf hive.enforce.bucketing=false -jobconf hive.limit.optimize.fetch.max=50000 -jobconf hive.exec.script.allow.partial.consumption=false -jobconf hive.archive.enabled=false -jobconf hive.support.concurrency=true -jobconf hive.mapjoin.hashtable.loadfactor=0.75 -jobconf hive.mapred.reduce.tasks.speculative.execution=true -jobconf hive.heartbeat.interval=1000 -jobconf hive.exec.counters.pull.interval=1000 -jobconf hive.mapjoin.maxsize=100000 -jobconf javax.jdo.option.NonTransactionalRead=true -jobconf hive.optimize.cp=true -jobconf hive.exec.reducers.bytes.per.reducer=1000000000 -jobconf test.query.file1=file%3A%2F%2F%24%7Buser.dir%7D%2F..%2Fql%2Fsrc%2Ftest%2Forg%2Fapache%2Fhadoop%2Fhive%2Fql%2Finput2.q -jobconf hive.error.on.empty.partition=false -jobconf hive.security.authorization.enabled=false -jobconf mapred.system.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Fsystem%2F320721048 -jobconf mapred.local.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Flocal%2F1520248665 2011-04-29 11:09:58,477 INFO exec.ConditionalTask (MapRedTask.java:execute(266)) - Execution completed successfully 2011-04-29 11:09:58,550 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Ended Job = -1336823384, job is filtered out (removed at runtime). 2011-04-29 11:09:58,567 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Moving data to: pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-52_740_3043453006429688721/-ext-10000 from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-52_740_3043453006429688721/-ext-10002 2011-04-29 11:09:58,601 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Loading data to table default.temp from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-52_740_3043453006429688721/-ext-10000 2011-04-29 11:09:58,601 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:09:58,620 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:58,620 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@266e63d9] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:58,621 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:09:58,634 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:58,635 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@6a162595] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:58,861 DEBUG metadata.Hive (Hive.java:replaceFiles(1944)) - Renaming:pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-52_740_3043453006429688721/-ext-10000 to /Users/rmelick/hive/build/ql/test/data/warehouse/temp,Status:true 2011-04-29 11:09:58,863 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=temp newtbl=temp 2011-04-29 11:09:58,910 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:09:58,923 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:58,924 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@6bd07324] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:59,246 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:09:59,263 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:59,263 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@304b0cbc] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:59,294 INFO jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:aggregateStats(63)) - Stats Aggregator for key pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-52_740_3043453006429688721/-ext-10000/ 2011-04-29 11:09:59,303 ERROR jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:aggregateStats(109)) - Error during publishing aggregation. java.sql.SQLSyntaxErrorException: Table/View 'PARTITION_STAT_TBL' does not exist. 2011-04-29 11:09:59,304 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=temp newtbl=temp 2011-04-29 11:09:59,343 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Table default.temp stats: [num_partitions: 0, num_files: 1, num_rows: 0, total_size: 390] 2011-04-29 11:09:59,395 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,395 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: INSERT OVERWRITE TABLE temp SELECT * FROM src WHERE key < 50 2011-04-29 11:09:59,396 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: QUERY 2011-04-29 11:09:59,396 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Input: default@src 2011-04-29 11:09:59,397 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@temp 2011-04-29 11:09:59,397 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:09:59,398 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:09:59,398 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,399 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,400 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:59,401 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,403 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:delete cxid:0xa zxid:0xa6 txntype:2 reqpath:n/a 2011-04-29 11:09:59,404 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:delete cxid:0xa zxid:0xa6 txntype:2 reqpath:n/a 2011-04-29 11:09:59,405 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,166,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:09:59,405 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:09:59,406 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:09:59,406 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,166,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{} 2011-04-29 11:09:59,408 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:delete cxid:0xc zxid:0xa7 txntype:2 reqpath:n/a 2011-04-29 11:09:59,408 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:delete cxid:0xc zxid:0xa7 txntype:2 reqpath:n/a 2011-04-29 11:09:59,409 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,167,0 request:: '/hive_zookeeper_namespace/default/temp,-1 response:: null 2011-04-29 11:09:59,410 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:delete cxid:0xd zxid:0xa8 txntype:2 reqpath:n/a 2011-04-29 11:09:59,410 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:delete cxid:0xd zxid:0xa8 txntype:2 reqpath:n/a 2011-04-29 11:09:59,411 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 13,2 replyHeader:: 13,168,0 request:: '/hive_zookeeper_namespace/default/src/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:59,412 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:getChildren cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:09:59,412 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:getChildren cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:09:59,413 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 14,8 replyHeader:: 14,168,0 request:: '/hive_zookeeper_namespace/default/src,F response:: v{} 2011-04-29 11:09:59,414 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:delete cxid:0xf zxid:0xa9 txntype:2 reqpath:n/a 2011-04-29 11:09:59,414 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:delete cxid:0xf zxid:0xa9 txntype:2 reqpath:n/a 2011-04-29 11:09:59,415 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 15,2 replyHeader:: 15,169,0 request:: '/hive_zookeeper_namespace/default/src,-1 response:: null 2011-04-29 11:09:59,416 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:delete cxid:0x10 zxid:0xaa txntype:2 reqpath:n/a 2011-04-29 11:09:59,416 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:delete cxid:0x10 zxid:0xaa txntype:2 reqpath:n/a 2011-04-29 11:09:59,417 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 16,2 replyHeader:: 16,170,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:09:59,417 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:getChildren cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:59,417 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:getChildren cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:09:59,418 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 17,8 replyHeader:: 17,170,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:09:59,419 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:delete cxid:0x12 zxid:0xab txntype:2 reqpath:n/a 2011-04-29 11:09:59,420 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:delete cxid:0x12 zxid:0xab txntype:2 reqpath:n/a 2011-04-29 11:09:59,420 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 18,2 replyHeader:: 18,171,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:09:59,421 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,422 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 6.683 seconds 2011-04-29 11:09:59,423 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,423 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: -- Build an index on temp. CREATE INDEX temp_index ON TABLE temp(key) as 'COMPACT' WITH DEFERRED REBUILD 2011-04-29 11:09:59,424 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: -- Build an index on temp. CREATE INDEX temp_index ON TABLE temp(key) as 'COMPACT' WITH DEFERRED REBUILD 2011-04-29 11:09:59,426 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:59,430 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:09:59,431 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:09:59,431 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,431 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,431 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,432 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,432 INFO ql.Driver (Driver.java:execute(972)) - Starting command: -- Build an index on temp. CREATE INDEX temp_index ON TABLE temp(key) as 'COMPACT' WITH DEFERRED REBUILD 2011-04-29 11:09:59,433 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,433 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: -- Build an index on temp. CREATE INDEX temp_index ON TABLE temp(key) as 'COMPACT' WITH DEFERRED REBUILD 2011-04-29 11:09:59,433 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: CREATEINDEX 2011-04-29 11:09:59,433 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,434 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,434 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,435 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_index_by_name: db=default tbl=temp index=temp_index 2011-04-29 11:09:59,469 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:09:59,491 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: add_index: db=default tbl=temp index=temp_index 2011-04-29 11:09:59,492 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_index_by_name: db=default tbl=temp index=temp_index 2011-04-29 11:09:59,505 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: create_table: db=default tbl=default__temp_temp_index__ 2011-04-29 11:09:59,508 DEBUG metastore.warehouse (Warehouse.java:mkdirs(169)) - Creating directory if it doesn't exist: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ 2011-04-29 11:09:59,613 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,614 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: -- Build an index on temp. CREATE INDEX temp_index ON TABLE temp(key) as 'COMPACT' WITH DEFERRED REBUILD 2011-04-29 11:09:59,614 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: CREATEINDEX 2011-04-29 11:09:59,614 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:09:59,614 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:09:59,615 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,615 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,615 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:09:59,615 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,616 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:09:59,616 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 0.193 seconds 2011-04-29 11:09:59,616 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,616 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: ALTER INDEX temp_index ON temp REBUILD 2011-04-29 11:09:59,617 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: ALTER INDEX temp_index ON temp REBUILD 2011-04-29 11:09:59,619 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:59,620 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_index_by_name: db=default tbl=temp index=temp_index 2011-04-29 11:09:59,666 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:09:59,683 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:09:59,685 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@6edcda91] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:59,686 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:09:59,722 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:59,747 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@4662de7b] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:59,747 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:09:59,748 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:59,787 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:09:59,787 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: INSERT OVERWRITE TABLE `default__temp_temp_index__` SELECT `key`,INPUT__FILE__NAME, collect_set (BLOCK__OFFSET__INSIDE__FILE) FROM `temp` GROUP BY `key`, INPUT__FILE__NAME 2011-04-29 11:09:59,788 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: INSERT OVERWRITE TABLE `default__temp_temp_index__` SELECT `key`,INPUT__FILE__NAME, collect_set (BLOCK__OFFSET__INSIDE__FILE) FROM `temp` GROUP BY `key`, INPUT__FILE__NAME 2011-04-29 11:09:59,918 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:09:59,918 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:09:59,919 DEBUG exec.FunctionRegistry (FunctionRegistry.java:getGenericUDAFResolver(765)) - Looking up GenericUDAF: collect_set 2011-04-29 11:09:59,919 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6792)) - Completed phase 1 of Semantic Analysis 2011-04-29 11:09:59,920 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(816)) - Get metadata for source tables 2011-04-29 11:09:59,920 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:09:59,941 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:09:59,942 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@3add750e] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:59,943 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(877)) - Get metadata for subqueries 2011-04-29 11:09:59,943 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(884)) - Get metadata for destination tables 2011-04-29 11:09:59,943 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:09:59,963 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:09:59,964 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@305f849b] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:09:59,964 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6795)) - Completed getting MetaData in Semantic Analysis 2011-04-29 11:09:59,965 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(5962)) - Created Table Plan for temp org.apache.hadoop.hive.ql.exec.TableScanOperator@4efaf4ec 2011-04-29 11:09:59,968 DEBUG exec.FunctionRegistry (FunctionRegistry.java:getGenericUDAFResolver(765)) - Looking up GenericUDAF: collect_set 2011-04-29 11:09:59,980 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1933)) - tree: (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL `key`)) (TOK_SELEXPR (TOK_TABLE_OR_COL INPUT__FILE__NAME)) (TOK_SELEXPR (TOK_FUNCTION collect_set (TOK_TABLE_OR_COL BLOCK__OFFSET__INSIDE__FILE)))) 2011-04-29 11:09:59,981 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2034)) - genSelectPlan: input = {((tok_table_or_col `key`),_col0: string)((tok_table_or_col input__file__name),_col1: string)((tok_function collect_set (tok_table_or_col block__offset__inside__file)),_col2: array)} 2011-04-29 11:09:59,981 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2151)) - Created Select Plan row schema: null{(`key`,_col0: string)(input__file__name,_col1: string)(_c2,_col2: array)} 2011-04-29 11:09:59,982 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1922)) - Created Select Plan for clause: insclause-0 2011-04-29 11:10:00,017 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:00,018 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@520cec87] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:00,021 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@4e7cbd26] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:00,022 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(3877)) - Created FileSink Plan for clause: insclause-0dest_path: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ row schema: null{(`key`,_col0: string)(input__file__name,_col1: string)(_c2,_col2: array)} 2011-04-29 11:10:00,022 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(5560)) - Created Body Plan for Query Block null 2011-04-29 11:10:00,022 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(6079)) - Created Plan for Query Block null 2011-04-29 11:10:00,055 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for FS(6) 2011-04-29 11:10:00,056 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(5) 2011-04-29 11:10:00,056 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for GBY(4) 2011-04-29 11:10:00,057 INFO ppd.OpProcFactory (OpProcFactory.java:process(261)) - Processing for RS(3) 2011-04-29 11:10:00,057 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for GBY(2) 2011-04-29 11:10:00,057 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(1) 2011-04-29 11:10:00,058 INFO ppd.OpProcFactory (OpProcFactory.java:process(124)) - Processing for TS(0) 2011-04-29 11:10:00,061 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(168)) - Started pruning partiton 2011-04-29 11:10:00,061 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(169)) - dbname = default 2011-04-29 11:10:00,061 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(170)) - tabname = temp 2011-04-29 11:10:00,062 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(171)) - prune Expression = null 2011-04-29 11:10:00,062 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:00,062 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:00,063 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@40b3c884] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:00,063 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:00,064 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(692)) - Adding pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp of tabletemp 2011-04-29 11:10:00,064 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(725)) - Information added for path pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp 2011-04-29 11:10:00,066 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6833)) - Completed plan generation 2011-04-29 11:10:00,066 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:00,067 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:`key`, type:string, comment:null), FieldSchema(name:input__file__name, type:string, comment:null), FieldSchema(name:_c2, type:array, comment:null)], properties:null) 2011-04-29 11:10:00,067 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:00,069 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:00,069 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:10:00,070 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:00,070 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:00,070 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0013 2011-04-29 11:10:00,071 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0013 2011-04-29 11:10:00,072 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0013 2011-04-29 11:10:00,073 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0013 type:closeSession cxid:0x13 zxid:0xac txntype:-11 reqpath:n/a 2011-04-29 11:10:00,073 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0013 type:closeSession cxid:0x13 zxid:0xac txntype:-11 reqpath:n/a 2011-04-29 11:10:00,074 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0013, packet:: clientPath:null serverPath:null finished:false header:: 19,-11 replyHeader:: 19,172,0 request:: null response:: null 2011-04-29 11:10:00,074 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /0:0:0:0:0:0:0:1%0:56324 which had sessionid 0x12fa2738adb0013 2011-04-29 11:10:00,074 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0013 2011-04-29 11:10:00,075 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0013 : Unable to read additional data from server sessionid 0x12fa2738adb0013, likely server has closed socket 2011-04-29 11:10:00,077 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0013 closed 2011-04-29 11:10:00,077 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:10:00,077 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@4a1d6e77 2011-04-29 11:10:00,078 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:10:00,080 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/0:0:0:0:0:0:0:1:21818, initiating session 2011-04-29 11:10:00,082 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:10:00,082 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /0:0:0:0:0:0:0:1%0:56325 2011-04-29 11:10:00,083 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /0:0:0:0:0:0:0:1%0:56325 client's lastZxid is 0x0 2011-04-29 11:10:00,083 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /0:0:0:0:0:0:0:1%0:56325 2011-04-29 11:10:00,084 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:createSession cxid:0x0 zxid:0xad txntype:-10 reqpath:n/a 2011-04-29 11:10:00,084 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:createSession cxid:0x0 zxid:0xad txntype:-10 reqpath:n/a 2011-04-29 11:10:00,085 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0014 with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1%0:56325 2011-04-29 11:10:00,085 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21818, sessionid = 0x12fa2738adb0014, negotiated timeout = 40000 2011-04-29 11:10:00,086 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:create cxid:0x1 zxid:0xae txntype:1 reqpath:n/a 2011-04-29 11:10:00,086 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:create cxid:0x1 zxid:0xae txntype:1 reqpath:n/a 2011-04-29 11:10:00,087 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,174,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:10:00,088 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:create cxid:0x2 zxid:0xaf txntype:1 reqpath:n/a 2011-04-29 11:10:00,089 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:create cxid:0x2 zxid:0xaf txntype:1 reqpath:n/a 2011-04-29 11:10:00,089 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,175,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f63353665356134332d336466332d343665312d613664632d3831356431386439373161373a313330343130303630303037303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:10:00,090 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:00,090 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:00,091 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,175,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:00,092 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:create cxid:0x4 zxid:0xb0 txntype:1 reqpath:n/a 2011-04-29 11:10:00,092 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:create cxid:0x4 zxid:0xb0 txntype:1 reqpath:n/a 2011-04-29 11:10:00,093 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,176,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:00,095 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:create cxid:0x5 zxid:0xb1 txntype:1 reqpath:n/a 2011-04-29 11:10:00,096 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:create cxid:0x5 zxid:0xb1 txntype:1 reqpath:n/a 2011-04-29 11:10:00,096 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,177,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131313031305f63353665356134332d336466332d343665312d613664632d3831356431386439373161373a313330343130303630303037303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:10:00,097 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:00,097 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:00,098 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,177,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:10:00,099 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:create cxid:0x7 zxid:0xb2 txntype:1 reqpath:n/a 2011-04-29 11:10:00,100 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:create cxid:0x7 zxid:0xb2 txntype:1 reqpath:n/a 2011-04-29 11:10:00,100 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 7,1 replyHeader:: 7,178,0 request:: '/hive_zookeeper_namespace/default/temp,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:00,101 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:create cxid:0x8 zxid:0xb3 txntype:1 reqpath:n/a 2011-04-29 11:10:00,102 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:create cxid:0x8 zxid:0xb3 txntype:1 reqpath:n/a 2011-04-29 11:10:00,103 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 8,1 replyHeader:: 8,179,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f63353665356134332d336466332d343665312d613664632d3831356431386439373161373a313330343130303630303037303a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/temp/LOCK-SHARED-0000000000 2011-04-29 11:10:00,103 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:getChildren cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:00,103 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:getChildren cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:00,104 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 9,8 replyHeader:: 9,179,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:00,104 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:00,105 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:00,105 INFO ql.Driver (Driver.java:execute(972)) - Starting command: ALTER INDEX temp_index ON temp REBUILD 2011-04-29 11:10:00,107 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:00,107 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: ALTER INDEX temp_index ON temp REBUILD 2011-04-29 11:10:00,107 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: QUERY 2011-04-29 11:10:00,108 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Input: default@temp 2011-04-29 11:10:00,108 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@default__temp_temp_index__ 2011-04-29 11:10:00,108 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:00,108 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:00,108 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:00,109 INFO ql.Driver (SessionState.java:printInfo(365)) - Total MapReduce jobs = 1 2011-04-29 11:10:00,109 INFO ql.Driver (SessionState.java:printInfo(365)) - Launching Job 1 out of 1 2011-04-29 11:10:00,187 INFO exec.Utilities (Utilities.java:getInputSummary(1704)) - Cache Content Summary for pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp length: 390 file count: 1 directory count: 1 2011-04-29 11:10:00,188 INFO index.IndexMetadataChangeTask (MapRedTask.java:estimateNumberOfReducers(371)) - BytesPerReducer=1000000000 maxReducers=999 totalInputFileSize=390 2011-04-29 11:10:00,188 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - Number of reduce tasks not specified. Estimated from input data size: 1 2011-04-29 11:10:00,189 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - In order to change the average load for a reducer (in bytes): 2011-04-29 11:10:00,189 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - set hive.exec.reducers.bytes.per.reducer= 2011-04-29 11:10:00,189 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - In order to limit the maximum number of reducers: 2011-04-29 11:10:00,189 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - set hive.exec.reducers.max= 2011-04-29 11:10:00,189 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - In order to set a constant number of reducers: 2011-04-29 11:10:00,190 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - set mapred.reduce.tasks= 2011-04-29 11:10:00,235 INFO index.IndexMetadataChangeTask (MapRedTask.java:execute(161)) - Generating plan file file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-09-59_617_651642571996335280/-local-10000/plan.xml 2011-04-29 11:10:00,428 INFO index.IndexMetadataChangeTask (MapRedTask.java:execute(198)) - Executing: /Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/bin/hadoop jar /Users/rmelick/hive/build/ql/hive-exec-0.8.0-SNAPSHOT.jar org.apache.hadoop.hive.ql.exec.ExecDriver -libjars file:///Users/rmelick/hive/build/ql/test/test-udfs.jar -plan file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-09-59_617_651642571996335280/-local-10000/plan.xml -nolog -jobconf hive.stats.jdbcdriver=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.aux.jars.path=file%3A%2F%2F%2FUsers%2Frmelick%2Fhive%2Fbuild%2Fql%2Ftest%2Ftest-udfs.jar -jobconf hive.mapjoin.followby.gby.localtask.max.memory.usage=0.55 -jobconf hive.limit.optimize.limit.file=10 -jobconf datanucleus.validateColumns=false -jobconf datanucleus.connectionPoolingType=DBCP -jobconf hadoop.tmp.dir=%24%7Bbuild.dir.hive%7D%2Ftest%2Fhadoop-%24%7Buser.name%7D -jobconf test.src.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Fsrc%2Ftest -jobconf hive.variable.substitute=true -jobconf hive.stats.dbclass=jdbc%3Aderby -jobconf hive.lock.mapred.only.operation=false -jobconf hive.script.serde=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe -jobconf hive.merge.smallfiles.avgsize=16000000 -jobconf datanucleus.cache.level2=false -jobconf hive.hbase.wal.enabled=true -jobconf hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider -jobconf hive.metastore.rawstore.impl=org.apache.hadoop.hive.metastore.ObjectStore -jobconf hive.metastore.local=true -jobconf hive.optimize.ppd.storage=true -jobconf hive.querylog.location=%24%7Bbuild.dir%7D%2Ftmp -jobconf hive.limit.row.max.size=100000 -jobconf hive.rework.mapredwork=false -jobconf hive.added.jars.path= -jobconf hive.metastore.authorization.storage.checks=false -jobconf hive.zookeeper.namespace=hive_zookeeper_namespace -jobconf hive.test.mode.prefix=test_ -jobconf hive.test.mode=false -jobconf hive.exec.compress.intermediate=false -jobconf datanucleus.cache.level2.type=SOFT -jobconf hive.metastore.ds.retry.attempts=1 -jobconf hive.limit.optimize.enable=false -jobconf hive.zookeeper.client.port=21818 -jobconf javax.jdo.option.ConnectionUserName=APP -jobconf hive.merge.mapfiles=true -jobconf hive.test.mode.samplefreq=32 -jobconf hive.optimize.skewjoin=false -jobconf hive.metastore.server.min.threads=200 -jobconf hive.mapjoin.localtask.max.memory.usage=0.90 -jobconf hive.map.aggr.hash.min.reduction=0.5 -jobconf hive.exec.compress.output=false -jobconf hive.script.recordreader=org.apache.hadoop.hive.ql.exec.TextRecordReader -jobconf javax.jdo.option.Multithreaded=true -jobconf hive.exec.post.hooks=org.apache.hadoop.hive.ql.hooks.PostExecutePrinter -jobconf hive.lock.numretries=100 -jobconf hive.exec.parallel.thread.number=8 -jobconf hive.exec.max.created.files=100000 -jobconf hive.exec.default.partition.name=__HIVE_DEFAULT_PARTITION__ -jobconf test.log.dir=%24%7Bbuild.dir%7D%2Ftest%2Flogs -jobconf hive.archive.har.parentdir.settable=false -jobconf hive.exec.pre.hooks=org.apache.hadoop.hive.ql.hooks.PreExecutePrinter%2C+org.apache.hadoop.hive.ql.hooks.EnforceReadOnlyTables -jobconf hive.exec.mode.local.auto=false -jobconf hive.optimize.index.filter=false -jobconf datanucleus.storeManagerType=rdbms -jobconf hive.script.operator.id.env.var=HIVE_SCRIPT_OPERATOR_ID -jobconf hive.metastore.ds.retry.interval=1000 -jobconf hive.skewjoin.mapjoin.min.split=33554432 -jobconf hive.metastore.client.connect.retry.delay=1 -jobconf hive.auto.convert.join=false -jobconf hive.metastore.warehouse.dir=%24%7Btest.warehouse.dir%7D -jobconf hive.mapjoin.bucket.cache.size=100 -jobconf datanucleus.transactionIsolation=read-committed -jobconf hive.stats.jdbc.timeout=30 -jobconf hive.concurrency.manager=org.apache.hadoop.hive.ql.lockmgr.ZooKeeperLockMgr -jobconf hive.mergejob.maponly=true -jobconf hive.fetch.output.serde=org.apache.hadoop.hive.serde2.DelimitedJSONSerDe -jobconf hive.mapjoin.followby.map.aggr.hash.percentmemory=0.3 -jobconf hive.exim.uri.scheme.whitelist=hdfs%2Cpfile -jobconf hive.stats.dbconnectionstring=jdbc%3Aderby%3A%3BdatabaseName%3DTempStatsStore%3Bcreate%3Dtrue -jobconf mapred.reduce.tasks=-1 -jobconf hive.optimize.index.filter.compact.minsize=5368709120 -jobconf hive.skewjoin.key=100000 -jobconf javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.DummyAuthenticator -jobconf hive.udtf.auto.progress=false -jobconf hive.session.id=rmelick_201104291109 -jobconf mapred.job.name=ALTER+INDEX+temp_index+ON+temp+REBUILD%28Stage-1%29 -jobconf hive.exec.script.maxerrsize=100000 -jobconf hive.optimize.groupby=true -jobconf datanucleus.plugin.pluginRegistryBundleCheck=LOG -jobconf hive.exec.rowoffset=false -jobconf hive.default.fileformat=TextFile -jobconf hive.mapjoin.smalltable.filesize=25000000 -jobconf hive.exec.scratchdir=%24%7Bbuild.dir%7D%2Fscratchdir -jobconf datanucleus.identifierFactory=datanucleus -jobconf hive.exec.max.dynamic.partitions.pernode=100 -jobconf hive.join.emit.interval=1000 -jobconf hive.script.recordwriter=org.apache.hadoop.hive.ql.exec.TextRecordWriter -jobconf datanucleus.validateConstraints=false -jobconf hive.exec.dynamic.partition=false -jobconf hive.optimize.index.filter.compact.maxsize=-1 -jobconf hive.metastore.client.socket.timeout=20 -jobconf hive.map.aggr.hash.force.flush.memory.threshold=0.9 -jobconf hive.exec.show.job.failure.debug.info=false -jobconf hive.join.cache.size=25000 -jobconf datanucleus.autoStartMechanismMode=checked -jobconf hive.input.format=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat -jobconf hive.skewjoin.mapjoin.map.tasks=10000 -jobconf hive.exec.drop.ignorenonexistent=true -jobconf hive.hwi.listen.port=9999 -jobconf hive.session.silent=true -jobconf hive.cli.print.header=false -jobconf hive.groupby.mapaggr.checkinterval=100000 -jobconf hive.metastore.server.max.threads=100000 -jobconf hive.metastore.kerberos.principal=hive-metastore%2F_HOST%40EXAMPLE.COM -jobconf javax.jdo.option.ConnectionURL=jdbc%3Aderby%3A%3BdatabaseName%3D..%2Fbuild%2Ftest%2Fjunit_metastore_db%3Bcreate%3Dtrue -jobconf hive.mapred.mode=nonstrict -jobconf hive.metastore.batch.retrieve.max=300 -jobconf hive.groupby.skewindata=false -jobconf hive.exec.parallel=false -jobconf hive.zookeeper.clean.extra.nodes=false -jobconf test.data.files=%24%7Buser.dir%7D%2F..%2Fdata%2Ffiles -jobconf hive.merge.size.per.task=256000000 -jobconf fs.har.impl=org.apache.hadoop.hive.shims.HiveHarFileSystem -jobconf hive.exec.reducers.max=999 -jobconf fs.pfile.impl=org.apache.hadoop.fs.ProxyLocalFileSystem -jobconf hive.query.string=%0AALTER+INDEX+temp_index+ON+temp+REBUILD -jobconf hive.optimize.ppd=true -jobconf hive.metastore.cache.pinobjtypes=Table%2CStorageDescriptor%2CSerDeInfo%2CPartition%2CDatabase%2CType%2CFieldSchema%2COrder -jobconf hive.mapjoin.hashtable.initialCapacity=100000 -jobconf hive.jar.path=%24%7Bbuild.dir.hive%7D%2Fql%2Fhive-exec-%24%7Bversion%7D.jar -jobconf hive.mapjoin.cache.numrows=25000 -jobconf hive.merge.mapredfiles=false -jobconf hive.metastore.sasl.enabled=false -jobconf hive.fileformat.check=true -jobconf hive.metastore.connect.retries=5 -jobconf hive.query.id=rmelick_20110429111010_c56e5a43-3df3-46e1-a6dc-815d18d971a7 -jobconf hive.zookeeper.quorum=localhost -jobconf javax.jdo.option.DetachAllOnCommit=true -jobconf hive.metastore.metadb.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Ftest%2Fdata%2Fmetadb%2F -jobconf javax.jdo.option.ConnectionPassword=mine -jobconf hive.optimize.pruner=true -jobconf hive.optimize.reducededuplication=true -jobconf hive.hwi.listen.host=0.0.0.0 -jobconf hive.index.compact.file.ignore.hdfs=false -jobconf hive.auto.progress.timeout=0 -jobconf hive.map.aggr.hash.percentmemory=0.5 -jobconf hive.mapjoin.check.memory.rows=100000 -jobconf javax.jdo.PersistenceManagerFactoryClass=org.datanucleus.jdo.JDOPersistenceManagerFactory -jobconf hive.mapred.local.mem=0 -jobconf datanucleus.validateTables=false -jobconf hive.exec.max.dynamic.partitions=1000 -jobconf hive.stats.jdbc.atomic=false -jobconf hive.exec.dynamic.partition.mode=strict -jobconf hive.hwi.war.file=lib%2Fhive-hwi-%40VERSION%40.war -jobconf hive.script.auto.progress=false -jobconf hive.lock.sleep.between.retries=60 -jobconf hive.enforce.sorting=false -jobconf datanucleus.autoCreateSchema=true -jobconf hive.task.progress=false -jobconf hive.metastore.server.tcp.keepalive=true -jobconf hive.stats.autogather=true -jobconf hive.map.aggr=true -jobconf hive.enforce.bucketing=false -jobconf hive.limit.optimize.fetch.max=50000 -jobconf hive.exec.script.allow.partial.consumption=false -jobconf hive.archive.enabled=false -jobconf hive.support.concurrency=true -jobconf hive.mapjoin.hashtable.loadfactor=0.75 -jobconf hive.mapred.reduce.tasks.speculative.execution=true -jobconf hive.heartbeat.interval=1000 -jobconf hive.exec.counters.pull.interval=1000 -jobconf hive.mapjoin.maxsize=100000 -jobconf javax.jdo.option.NonTransactionalRead=true -jobconf hive.optimize.cp=true -jobconf hive.exec.reducers.bytes.per.reducer=1000000000 -jobconf test.query.file1=file%3A%2F%2F%24%7Buser.dir%7D%2F..%2Fql%2Fsrc%2Ftest%2Forg%2Fapache%2Fhadoop%2Fhive%2Fql%2Finput2.q -jobconf hive.error.on.empty.partition=false -jobconf hive.security.authorization.enabled=false -jobconf mapred.system.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Fsystem%2F713538493 -jobconf mapred.local.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Flocal%2F332376958 2011-04-29 11:10:05,437 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:05,437 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:05,438 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(721)) - Got ping response for sessionid: 0x12fa2738adb0010 after 2ms 2011-04-29 11:10:05,823 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0011 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:05,823 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0011 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:05,824 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(721)) - Got ping response for sessionid: 0x12fa2738adb0011 after 2ms 2011-04-29 11:10:06,687 INFO index.IndexMetadataChangeTask (MapRedTask.java:execute(266)) - Execution completed successfully 2011-04-29 11:10:06,690 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - Loading data to table default.default__temp_temp_index__ from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-59_788_5650279037930394104/-ext-10000 2011-04-29 11:10:06,691 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:06,712 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:06,713 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@6af30a3] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:06,714 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:06,736 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:06,737 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@48719726] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:06,830 DEBUG metadata.Hive (Hive.java:replaceFiles(1944)) - Renaming:pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-59_788_5650279037930394104/-ext-10000 to /Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__,Status:true 2011-04-29 11:10:06,831 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=default__temp_temp_index__ newtbl=default__temp_temp_index__ 2011-04-29 11:10:06,940 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:06,957 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:06,958 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@5ddfba0e] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:06,989 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=default__temp_temp_index__ newtbl=default__temp_temp_index__ 2011-04-29 11:10:07,038 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:07,052 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:07,052 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@1f2c8b2a] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:07,202 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:07,219 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:07,220 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@498654ae] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:07,254 INFO jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:aggregateStats(63)) - Stats Aggregator for key pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-09-59_788_5650279037930394104/-ext-10000/ 2011-04-29 11:10:07,272 ERROR jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:aggregateStats(109)) - Error during publishing aggregation. java.sql.SQLSyntaxErrorException: Table/View 'PARTITION_STAT_TBL' does not exist. 2011-04-29 11:10:07,282 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=default__temp_temp_index__ newtbl=default__temp_temp_index__ 2011-04-29 11:10:07,348 INFO index.IndexMetadataChangeTask (SessionState.java:printInfo(365)) - Table default.default__temp_temp_index__ stats: [num_partitions: 0, num_files: 1, num_rows: 0, total_size: 2162] 2011-04-29 11:10:07,355 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:07,356 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: ALTER INDEX temp_index ON temp REBUILD 2011-04-29 11:10:07,356 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: QUERY 2011-04-29 11:10:07,356 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Input: default@temp 2011-04-29 11:10:07,357 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@default__temp_temp_index__ 2011-04-29 11:10:07,357 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._bucketname SIMPLE [(temp)temp.FieldSchema(name:INPUT__FILE__NAME, type:string, comment:), ] 2011-04-29 11:10:07,357 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._offsets EXPRESSION [(temp)temp.FieldSchema(name:BLOCK__OFFSET__INSIDE__FILE, type:bigint, comment:), ] 2011-04-29 11:10:07,358 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__.key SIMPLE [(temp)temp.FieldSchema(name:key, type:string, comment:null), ] 2011-04-29 11:10:07,358 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:07,358 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:07,358 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:07,358 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:07,359 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:10:07,360 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:07,414 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:delete cxid:0xa zxid:0xb4 txntype:2 reqpath:n/a 2011-04-29 11:10:07,415 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:delete cxid:0xa zxid:0xb4 txntype:2 reqpath:n/a 2011-04-29 11:10:07,416 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,180,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:07,417 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:07,417 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:07,418 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,180,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{} 2011-04-29 11:10:07,420 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:delete cxid:0xc zxid:0xb5 txntype:2 reqpath:n/a 2011-04-29 11:10:07,420 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:delete cxid:0xc zxid:0xb5 txntype:2 reqpath:n/a 2011-04-29 11:10:07,421 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,181,0 request:: '/hive_zookeeper_namespace/default/temp,-1 response:: null 2011-04-29 11:10:07,423 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:delete cxid:0xd zxid:0xb6 txntype:2 reqpath:n/a 2011-04-29 11:10:07,423 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:delete cxid:0xd zxid:0xb6 txntype:2 reqpath:n/a 2011-04-29 11:10:07,424 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 13,2 replyHeader:: 13,182,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:10:07,425 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:getChildren cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:07,425 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:getChildren cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:07,426 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 14,8 replyHeader:: 14,182,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,F response:: v{} 2011-04-29 11:10:07,428 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:delete cxid:0xf zxid:0xb7 txntype:2 reqpath:n/a 2011-04-29 11:10:07,428 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:delete cxid:0xf zxid:0xb7 txntype:2 reqpath:n/a 2011-04-29 11:10:07,429 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 15,2 replyHeader:: 15,183,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,-1 response:: null 2011-04-29 11:10:07,430 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:delete cxid:0x10 zxid:0xb8 txntype:2 reqpath:n/a 2011-04-29 11:10:07,430 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:delete cxid:0x10 zxid:0xb8 txntype:2 reqpath:n/a 2011-04-29 11:10:07,431 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 16,2 replyHeader:: 16,184,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:07,432 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:getChildren cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:07,432 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:getChildren cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:07,433 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 17,8 replyHeader:: 17,184,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:10:07,435 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:delete cxid:0x12 zxid:0xb9 txntype:2 reqpath:n/a 2011-04-29 11:10:07,435 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:delete cxid:0x12 zxid:0xb9 txntype:2 reqpath:n/a 2011-04-29 11:10:07,435 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 18,2 replyHeader:: 18,185,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:10:07,436 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:07,437 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 7.821 seconds 2011-04-29 11:10:07,439 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: org.apache.hadoop.hive.ql.io.HiveInputFormat 2011-04-29 11:10:07,439 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: true 2011-04-29 11:10:07,440 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: 0 2011-04-29 11:10:07,440 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:07,440 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: -- overwrite temp table so index is out of date INSERT OVERWRITE TABLE temp SELECT * FROM src 2011-04-29 11:10:07,441 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: -- overwrite temp table so index is out of date INSERT OVERWRITE TABLE temp SELECT * FROM src 2011-04-29 11:10:07,442 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:10:07,442 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:10:07,443 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6792)) - Completed phase 1 of Semantic Analysis 2011-04-29 11:10:07,443 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(816)) - Get metadata for source tables 2011-04-29 11:10:07,443 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src 2011-04-29 11:10:07,457 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:10:07,457 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@6514af16] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:07,458 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(877)) - Get metadata for subqueries 2011-04-29 11:10:07,458 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(884)) - Get metadata for destination tables 2011-04-29 11:10:07,458 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:07,475 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:07,475 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@462d62d9] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:07,476 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6795)) - Completed getting MetaData in Semantic Analysis 2011-04-29 11:10:07,476 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(5962)) - Created Table Plan for src org.apache.hadoop.hive.ql.exec.TableScanOperator@4db4b88d 2011-04-29 11:10:07,476 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1933)) - tree: (TOK_SELECT (TOK_SELEXPR TOK_ALLCOLREF)) 2011-04-29 11:10:07,477 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2034)) - genSelectPlan: input = src{(key,key: string)(value,value: string)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:07,477 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2151)) - Created Select Plan row schema: src{(key,_col0: string)(value,_col1: string)} 2011-04-29 11:10:07,477 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1922)) - Created Select Plan for clause: insclause-0 2011-04-29 11:10:07,508 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:07,509 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@49a1afb1] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:07,509 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@1615b33b] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:07,510 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(3877)) - Created FileSink Plan for clause: insclause-0dest_path: pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp row schema: src{(key,_col0: string)(value,_col1: string)} 2011-04-29 11:10:07,510 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(5560)) - Created Body Plan for Query Block null 2011-04-29 11:10:07,510 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(6079)) - Created Plan for Query Block null 2011-04-29 11:10:07,512 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for FS(2) 2011-04-29 11:10:07,512 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(1) 2011-04-29 11:10:07,512 INFO ppd.OpProcFactory (OpProcFactory.java:process(124)) - Processing for TS(0) 2011-04-29 11:10:07,515 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(168)) - Started pruning partiton 2011-04-29 11:10:07,515 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(169)) - dbname = default 2011-04-29 11:10:07,515 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(170)) - tabname = src 2011-04-29 11:10:07,516 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(171)) - prune Expression = null 2011-04-29 11:10:07,516 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:10:07,516 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:10:07,517 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, value] columnTypes=[string, string] separator=[[B@2d316b22] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:07,517 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct src { string key, string value} 2011-04-29 11:10:07,517 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(692)) - Adding pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src of tablesrc 2011-04-29 11:10:07,518 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(725)) - Information added for path pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src 2011-04-29 11:10:07,518 INFO optimizer.GenMRFileSink1 (GenMRFileSink1.java:createMergeJob(279)) - use CombineHiveInputformat for the merge job 2011-04-29 11:10:07,522 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src 2011-04-29 11:10:07,522 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:07,528 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:07,528 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:07,529 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src 2011-04-29 11:10:07,529 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:07,531 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:07,532 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:07,532 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6833)) - Completed plan generation 2011-04-29 11:10:07,532 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:07,533 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:key, type:string, comment:null), FieldSchema(name:value, type:string, comment:null)], properties:null) 2011-04-29 11:10:07,533 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:07,534 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:07,534 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0014 2011-04-29 11:10:07,534 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0014 2011-04-29 11:10:07,537 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0014 2011-04-29 11:10:07,538 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0014 type:closeSession cxid:0x13 zxid:0xba txntype:-11 reqpath:n/a 2011-04-29 11:10:07,539 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0014 type:closeSession cxid:0x13 zxid:0xba txntype:-11 reqpath:n/a 2011-04-29 11:10:07,539 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0014, packet:: clientPath:null serverPath:null finished:false header:: 19,-11 replyHeader:: 19,186,0 request:: null response:: null 2011-04-29 11:10:07,540 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /0:0:0:0:0:0:0:1%0:56325 which had sessionid 0x12fa2738adb0014 2011-04-29 11:10:07,540 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0014 2011-04-29 11:10:07,540 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0014 : Unable to read additional data from server sessionid 0x12fa2738adb0014, likely server has closed socket 2011-04-29 11:10:07,540 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0014 closed 2011-04-29 11:10:07,542 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:10:07,542 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@a303147 2011-04-29 11:10:07,544 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:10:07,546 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:10:07,548 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56326 2011-04-29 11:10:07,548 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:10:07,548 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56326 client's lastZxid is 0x0 2011-04-29 11:10:07,548 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56326 2011-04-29 11:10:07,549 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:createSession cxid:0x0 zxid:0xbb txntype:-10 reqpath:n/a 2011-04-29 11:10:07,550 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:createSession cxid:0x0 zxid:0xbb txntype:-10 reqpath:n/a 2011-04-29 11:10:07,550 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0015 with negotiated timeout 40000 for client /127.0.0.1:56326 2011-04-29 11:10:07,551 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb0015, negotiated timeout = 40000 2011-04-29 11:10:07,552 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:create cxid:0x1 zxid:0xbc txntype:1 reqpath:n/a 2011-04-29 11:10:07,552 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:create cxid:0x1 zxid:0xbc txntype:1 reqpath:n/a 2011-04-29 11:10:07,553 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,188,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:10:07,554 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:create cxid:0x2 zxid:0xbd txntype:1 reqpath:n/a 2011-04-29 11:10:07,555 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:create cxid:0x2 zxid:0xbd txntype:1 reqpath:n/a 2011-04-29 11:10:07,555 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,189,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f62663038646263622d663436312d343735362d626139392d3138303961323862613164353a313330343130303630373533343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:10:07,556 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:07,556 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:07,557 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,189,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:07,559 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:create cxid:0x4 zxid:0xbe txntype:1 reqpath:n/a 2011-04-29 11:10:07,559 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:create cxid:0x4 zxid:0xbe txntype:1 reqpath:n/a 2011-04-29 11:10:07,560 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,190,0 request:: '/hive_zookeeper_namespace/default/src,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/src 2011-04-29 11:10:07,561 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:create cxid:0x5 zxid:0xbf txntype:1 reqpath:n/a 2011-04-29 11:10:07,561 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:create cxid:0x5 zxid:0xbf txntype:1 reqpath:n/a 2011-04-29 11:10:07,562 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,191,0 request:: '/hive_zookeeper_namespace/default/src/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f62663038646263622d663436312d343735362d626139392d3138303961323862613164353a313330343130303630373533343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/src/LOCK-SHARED-0000000000 2011-04-29 11:10:07,563 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:10:07,563 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:10:07,564 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,191,0 request:: '/hive_zookeeper_namespace/default/src,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:07,565 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:create cxid:0x7 zxid:0xc0 txntype:1 reqpath:n/a 2011-04-29 11:10:07,565 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:create cxid:0x7 zxid:0xc0 txntype:1 reqpath:n/a 2011-04-29 11:10:07,566 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 7,1 replyHeader:: 7,192,0 request:: '/hive_zookeeper_namespace/default/temp,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:07,567 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:create cxid:0x8 zxid:0xc1 txntype:1 reqpath:n/a 2011-04-29 11:10:07,568 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:create cxid:0x8 zxid:0xc1 txntype:1 reqpath:n/a 2011-04-29 11:10:07,568 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 8,1 replyHeader:: 8,193,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131313031305f62663038646263622d663436312d343735362d626139392d3138303961323862613164353a313330343130303630373533343a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:10:07,569 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:getChildren cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:07,569 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:getChildren cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:07,570 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 9,8 replyHeader:: 9,193,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:10:07,570 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:07,570 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:07,570 INFO ql.Driver (Driver.java:execute(972)) - Starting command: -- overwrite temp table so index is out of date INSERT OVERWRITE TABLE temp SELECT * FROM src 2011-04-29 11:10:07,572 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:07,573 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: -- overwrite temp table so index is out of date INSERT OVERWRITE TABLE temp SELECT * FROM src 2011-04-29 11:10:07,573 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: QUERY 2011-04-29 11:10:07,573 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Input: default@src 2011-04-29 11:10:07,574 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@temp 2011-04-29 11:10:07,574 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:07,574 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:07,574 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:07,575 INFO ql.Driver (SessionState.java:printInfo(365)) - Total MapReduce jobs = 2 2011-04-29 11:10:07,575 INFO ql.Driver (SessionState.java:printInfo(365)) - Launching Job 1 out of 2 2011-04-29 11:10:07,578 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Number of reduce tasks is set to 0 since there's no reduce operator 2011-04-29 11:10:07,632 INFO exec.ConditionalTask (MapRedTask.java:execute(161)) - Generating plan file file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-07_441_4889581724205500569/-local-10003/plan.xml 2011-04-29 11:10:07,742 INFO exec.ConditionalTask (MapRedTask.java:execute(198)) - Executing: /Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/bin/hadoop jar /Users/rmelick/hive/build/ql/hive-exec-0.8.0-SNAPSHOT.jar org.apache.hadoop.hive.ql.exec.ExecDriver -libjars file:///Users/rmelick/hive/build/ql/test/test-udfs.jar -plan file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-07_441_4889581724205500569/-local-10003/plan.xml -nolog -jobconf hive.stats.jdbcdriver=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.aux.jars.path=file%3A%2F%2F%2FUsers%2Frmelick%2Fhive%2Fbuild%2Fql%2Ftest%2Ftest-udfs.jar -jobconf hive.mapjoin.followby.gby.localtask.max.memory.usage=0.55 -jobconf hive.limit.optimize.limit.file=10 -jobconf datanucleus.validateColumns=false -jobconf datanucleus.connectionPoolingType=DBCP -jobconf hadoop.tmp.dir=%24%7Bbuild.dir.hive%7D%2Ftest%2Fhadoop-%24%7Buser.name%7D -jobconf test.src.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Fsrc%2Ftest -jobconf hive.variable.substitute=true -jobconf hive.stats.dbclass=jdbc%3Aderby -jobconf hive.lock.mapred.only.operation=false -jobconf hive.script.serde=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe -jobconf hive.merge.smallfiles.avgsize=16000000 -jobconf datanucleus.cache.level2=false -jobconf hive.hbase.wal.enabled=true -jobconf hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider -jobconf hive.metastore.rawstore.impl=org.apache.hadoop.hive.metastore.ObjectStore -jobconf hive.metastore.local=true -jobconf hive.optimize.ppd.storage=true -jobconf hive.querylog.location=%24%7Bbuild.dir%7D%2Ftmp -jobconf hive.limit.row.max.size=100000 -jobconf hive.rework.mapredwork=false -jobconf hive.added.jars.path= -jobconf hive.metastore.authorization.storage.checks=false -jobconf hive.zookeeper.namespace=hive_zookeeper_namespace -jobconf hive.test.mode.prefix=test_ -jobconf hive.test.mode=false -jobconf hive.exec.compress.intermediate=false -jobconf datanucleus.cache.level2.type=SOFT -jobconf hive.metastore.ds.retry.attempts=1 -jobconf hive.limit.optimize.enable=false -jobconf hive.zookeeper.client.port=21818 -jobconf javax.jdo.option.ConnectionUserName=APP -jobconf hive.merge.mapfiles=true -jobconf hive.test.mode.samplefreq=32 -jobconf hive.optimize.skewjoin=false -jobconf hive.metastore.server.min.threads=200 -jobconf hive.mapjoin.localtask.max.memory.usage=0.90 -jobconf hive.map.aggr.hash.min.reduction=0.5 -jobconf hive.exec.compress.output=false -jobconf hive.script.recordreader=org.apache.hadoop.hive.ql.exec.TextRecordReader -jobconf javax.jdo.option.Multithreaded=true -jobconf hive.exec.post.hooks=org.apache.hadoop.hive.ql.hooks.PostExecutePrinter -jobconf hive.lock.numretries=100 -jobconf hive.exec.parallel.thread.number=8 -jobconf hive.exec.max.created.files=100000 -jobconf hive.exec.default.partition.name=__HIVE_DEFAULT_PARTITION__ -jobconf test.log.dir=%24%7Bbuild.dir%7D%2Ftest%2Flogs -jobconf hive.archive.har.parentdir.settable=false -jobconf hive.exec.pre.hooks=org.apache.hadoop.hive.ql.hooks.PreExecutePrinter%2C+org.apache.hadoop.hive.ql.hooks.EnforceReadOnlyTables -jobconf hive.exec.mode.local.auto=false -jobconf hive.optimize.index.filter=true -jobconf datanucleus.storeManagerType=rdbms -jobconf hive.script.operator.id.env.var=HIVE_SCRIPT_OPERATOR_ID -jobconf hive.metastore.ds.retry.interval=1000 -jobconf hive.skewjoin.mapjoin.min.split=33554432 -jobconf hive.metastore.client.connect.retry.delay=1 -jobconf hive.auto.convert.join=false -jobconf hive.metastore.warehouse.dir=%24%7Btest.warehouse.dir%7D -jobconf hive.mapjoin.bucket.cache.size=100 -jobconf datanucleus.transactionIsolation=read-committed -jobconf hive.stats.jdbc.timeout=30 -jobconf hive.concurrency.manager=org.apache.hadoop.hive.ql.lockmgr.ZooKeeperLockMgr -jobconf hive.mergejob.maponly=true -jobconf hive.fetch.output.serde=org.apache.hadoop.hive.serde2.DelimitedJSONSerDe -jobconf hive.mapjoin.followby.map.aggr.hash.percentmemory=0.3 -jobconf hive.exim.uri.scheme.whitelist=hdfs%2Cpfile -jobconf hive.stats.dbconnectionstring=jdbc%3Aderby%3A%3BdatabaseName%3DTempStatsStore%3Bcreate%3Dtrue -jobconf mapred.reduce.tasks=-1 -jobconf hive.optimize.index.filter.compact.minsize=0 -jobconf hive.skewjoin.key=100000 -jobconf javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.DummyAuthenticator -jobconf hive.udtf.auto.progress=false -jobconf hive.session.id=rmelick_201104291109 -jobconf mapred.job.name=--+overwrite+temp+table+so+index+is+ou...src%28Stage-1%29 -jobconf hive.exec.script.maxerrsize=100000 -jobconf hive.optimize.groupby=true -jobconf datanucleus.plugin.pluginRegistryBundleCheck=LOG -jobconf hive.exec.rowoffset=false -jobconf hive.default.fileformat=TextFile -jobconf hive.mapjoin.smalltable.filesize=25000000 -jobconf hive.exec.scratchdir=%24%7Bbuild.dir%7D%2Fscratchdir -jobconf datanucleus.identifierFactory=datanucleus -jobconf hive.exec.max.dynamic.partitions.pernode=100 -jobconf hive.join.emit.interval=1000 -jobconf hive.script.recordwriter=org.apache.hadoop.hive.ql.exec.TextRecordWriter -jobconf datanucleus.validateConstraints=false -jobconf hive.exec.dynamic.partition=false -jobconf hive.optimize.index.filter.compact.maxsize=-1 -jobconf hive.metastore.client.socket.timeout=20 -jobconf hive.map.aggr.hash.force.flush.memory.threshold=0.9 -jobconf hive.exec.show.job.failure.debug.info=false -jobconf hive.join.cache.size=25000 -jobconf datanucleus.autoStartMechanismMode=checked -jobconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat -jobconf hive.skewjoin.mapjoin.map.tasks=10000 -jobconf hive.exec.drop.ignorenonexistent=true -jobconf hive.hwi.listen.port=9999 -jobconf hive.session.silent=true -jobconf hive.cli.print.header=false -jobconf hive.groupby.mapaggr.checkinterval=100000 -jobconf hive.metastore.server.max.threads=100000 -jobconf hive.metastore.kerberos.principal=hive-metastore%2F_HOST%40EXAMPLE.COM -jobconf javax.jdo.option.ConnectionURL=jdbc%3Aderby%3A%3BdatabaseName%3D..%2Fbuild%2Ftest%2Fjunit_metastore_db%3Bcreate%3Dtrue -jobconf hive.mapred.mode=nonstrict -jobconf hive.metastore.batch.retrieve.max=300 -jobconf hive.groupby.skewindata=false -jobconf hive.exec.parallel=false -jobconf hive.zookeeper.clean.extra.nodes=false -jobconf test.data.files=%24%7Buser.dir%7D%2F..%2Fdata%2Ffiles -jobconf hive.merge.size.per.task=256000000 -jobconf fs.har.impl=org.apache.hadoop.hive.shims.HiveHarFileSystem -jobconf hive.exec.reducers.max=999 -jobconf fs.pfile.impl=org.apache.hadoop.fs.ProxyLocalFileSystem -jobconf hive.query.string=%0A%0A--+overwrite+temp+table+so+index+is+out+of+date%0AINSERT+OVERWRITE+TABLE+temp+SELECT+*+FROM+src -jobconf hive.optimize.ppd=true -jobconf hive.metastore.cache.pinobjtypes=Table%2CStorageDescriptor%2CSerDeInfo%2CPartition%2CDatabase%2CType%2CFieldSchema%2COrder -jobconf hive.mapjoin.hashtable.initialCapacity=100000 -jobconf hive.jar.path=%24%7Bbuild.dir.hive%7D%2Fql%2Fhive-exec-%24%7Bversion%7D.jar -jobconf hive.mapjoin.cache.numrows=25000 -jobconf hive.merge.mapredfiles=false -jobconf hive.metastore.sasl.enabled=false -jobconf hive.fileformat.check=true -jobconf hive.metastore.connect.retries=5 -jobconf hive.query.id=rmelick_20110429111010_bf08dbcb-f461-4756-ba99-1809a28ba1d5 -jobconf hive.zookeeper.quorum=localhost -jobconf javax.jdo.option.DetachAllOnCommit=true -jobconf hive.metastore.metadb.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Ftest%2Fdata%2Fmetadb%2F -jobconf javax.jdo.option.ConnectionPassword=mine -jobconf hive.optimize.pruner=true -jobconf hive.optimize.reducededuplication=true -jobconf hive.hwi.listen.host=0.0.0.0 -jobconf hive.index.compact.file.ignore.hdfs=false -jobconf hive.auto.progress.timeout=0 -jobconf hive.map.aggr.hash.percentmemory=0.5 -jobconf hive.mapjoin.check.memory.rows=100000 -jobconf javax.jdo.PersistenceManagerFactoryClass=org.datanucleus.jdo.JDOPersistenceManagerFactory -jobconf hive.mapred.local.mem=0 -jobconf datanucleus.validateTables=false -jobconf hive.exec.max.dynamic.partitions=1000 -jobconf hive.stats.jdbc.atomic=false -jobconf hive.exec.dynamic.partition.mode=strict -jobconf hive.hwi.war.file=lib%2Fhive-hwi-%40VERSION%40.war -jobconf hive.script.auto.progress=false -jobconf hive.lock.sleep.between.retries=60 -jobconf hive.enforce.sorting=false -jobconf datanucleus.autoCreateSchema=true -jobconf hive.task.progress=false -jobconf hive.metastore.server.tcp.keepalive=true -jobconf hive.stats.autogather=true -jobconf hive.map.aggr=true -jobconf hive.enforce.bucketing=false -jobconf hive.limit.optimize.fetch.max=50000 -jobconf hive.exec.script.allow.partial.consumption=false -jobconf hive.archive.enabled=false -jobconf hive.support.concurrency=true -jobconf hive.mapjoin.hashtable.loadfactor=0.75 -jobconf hive.mapred.reduce.tasks.speculative.execution=true -jobconf hive.heartbeat.interval=1000 -jobconf hive.exec.counters.pull.interval=1000 -jobconf hive.mapjoin.maxsize=100000 -jobconf javax.jdo.option.NonTransactionalRead=true -jobconf hive.optimize.cp=true -jobconf hive.exec.reducers.bytes.per.reducer=1000000000 -jobconf test.query.file1=file%3A%2F%2F%24%7Buser.dir%7D%2F..%2Fql%2Fsrc%2Ftest%2Forg%2Fapache%2Fhadoop%2Fhive%2Fql%2Finput2.q -jobconf hive.error.on.empty.partition=false -jobconf hive.security.authorization.enabled=false -jobconf mapred.system.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Fsystem%2F515093703 -jobconf mapred.local.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Flocal%2F-852656180 2011-04-29 11:10:13,095 INFO exec.ConditionalTask (MapRedTask.java:execute(266)) - Execution completed successfully 2011-04-29 11:10:13,160 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Ended Job = 745365665, job is filtered out (removed at runtime). 2011-04-29 11:10:13,164 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Moving data to: pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-10-07_441_4889581724205500569/-ext-10000 from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-10-07_441_4889581724205500569/-ext-10002 2011-04-29 11:10:13,195 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Loading data to table default.temp from pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-10-07_441_4889581724205500569/-ext-10000 2011-04-29 11:10:13,196 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:13,220 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:13,221 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@4df3e7e8] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:13,221 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:13,236 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:13,237 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@2fa21acf] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:13,331 DEBUG metadata.Hive (Hive.java:replaceFiles(1944)) - Renaming:pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-10-07_441_4889581724205500569/-ext-10000 to /Users/rmelick/hive/build/ql/test/data/warehouse/temp,Status:true 2011-04-29 11:10:13,332 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=temp newtbl=temp 2011-04-29 11:10:13,425 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:13,442 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:13,442 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@275d13c3] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:13,455 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:13,472 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:13,473 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@27223041] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:13,505 INFO jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:aggregateStats(63)) - Stats Aggregator for key pfile:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-10-07_441_4889581724205500569/-ext-10000/ 2011-04-29 11:10:13,513 ERROR jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:aggregateStats(109)) - Error during publishing aggregation. java.sql.SQLSyntaxErrorException: Table/View 'PARTITION_STAT_TBL' does not exist. 2011-04-29 11:10:13,514 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: alter_table: db=default tbl=temp newtbl=temp 2011-04-29 11:10:13,556 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Table default.temp stats: [num_partitions: 0, num_files: 1, num_rows: 0, total_size: 5812] 2011-04-29 11:10:13,565 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:13,566 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: -- overwrite temp table so index is out of date INSERT OVERWRITE TABLE temp SELECT * FROM src 2011-04-29 11:10:13,566 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: QUERY 2011-04-29 11:10:13,566 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Input: default@src 2011-04-29 11:10:13,566 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@temp 2011-04-29 11:10:13,567 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._bucketname SIMPLE [(temp)temp.FieldSchema(name:INPUT__FILE__NAME, type:string, comment:), ] 2011-04-29 11:10:13,567 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._offsets EXPRESSION [(temp)temp.FieldSchema(name:BLOCK__OFFSET__INSIDE__FILE, type:bigint, comment:), ] 2011-04-29 11:10:13,567 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__.key SIMPLE [(temp)temp.FieldSchema(name:key, type:string, comment:null), ] 2011-04-29 11:10:13,567 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:13,568 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:13,568 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:13,568 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:13,568 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:13,569 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:13,570 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:10:13,570 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:13,572 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:delete cxid:0xa zxid:0xc2 txntype:2 reqpath:n/a 2011-04-29 11:10:13,573 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:delete cxid:0xa zxid:0xc2 txntype:2 reqpath:n/a 2011-04-29 11:10:13,574 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,194,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:10:13,574 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:13,574 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:13,575 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,194,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{} 2011-04-29 11:10:13,576 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:delete cxid:0xc zxid:0xc3 txntype:2 reqpath:n/a 2011-04-29 11:10:13,576 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:delete cxid:0xc zxid:0xc3 txntype:2 reqpath:n/a 2011-04-29 11:10:13,577 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,195,0 request:: '/hive_zookeeper_namespace/default/temp,-1 response:: null 2011-04-29 11:10:13,579 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:delete cxid:0xd zxid:0xc4 txntype:2 reqpath:n/a 2011-04-29 11:10:13,579 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:delete cxid:0xd zxid:0xc4 txntype:2 reqpath:n/a 2011-04-29 11:10:13,579 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 13,2 replyHeader:: 13,196,0 request:: '/hive_zookeeper_namespace/default/src/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:13,580 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:getChildren cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:10:13,580 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:getChildren cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/src 2011-04-29 11:10:13,581 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 14,8 replyHeader:: 14,196,0 request:: '/hive_zookeeper_namespace/default/src,F response:: v{} 2011-04-29 11:10:13,582 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:delete cxid:0xf zxid:0xc5 txntype:2 reqpath:n/a 2011-04-29 11:10:13,582 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:delete cxid:0xf zxid:0xc5 txntype:2 reqpath:n/a 2011-04-29 11:10:13,583 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 15,2 replyHeader:: 15,197,0 request:: '/hive_zookeeper_namespace/default/src,-1 response:: null 2011-04-29 11:10:13,584 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:delete cxid:0x10 zxid:0xc6 txntype:2 reqpath:n/a 2011-04-29 11:10:13,584 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:delete cxid:0x10 zxid:0xc6 txntype:2 reqpath:n/a 2011-04-29 11:10:13,585 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 16,2 replyHeader:: 16,198,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:13,585 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:getChildren cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:13,585 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:getChildren cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:13,586 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 17,8 replyHeader:: 17,198,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:10:13,587 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:delete cxid:0x12 zxid:0xc7 txntype:2 reqpath:n/a 2011-04-29 11:10:13,587 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:delete cxid:0x12 zxid:0xc7 txntype:2 reqpath:n/a 2011-04-29 11:10:13,588 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 18,2 replyHeader:: 18,199,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:10:13,588 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:13,590 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 6.15 seconds 2011-04-29 11:10:13,590 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:13,590 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: -- query should not return any values greater than 50 SELECT * FROM default__temp_temp_index__ WHERE key > 45 AND key < 55 2011-04-29 11:10:13,591 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: -- query should not return any values greater than 50 SELECT * FROM default__temp_temp_index__ WHERE key > 45 AND key < 55 2011-04-29 11:10:13,623 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:10:13,624 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:10:13,625 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6792)) - Completed phase 1 of Semantic Analysis 2011-04-29 11:10:13,625 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(816)) - Get metadata for source tables 2011-04-29 11:10:13,625 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:13,643 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:13,644 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@13a6d101] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:13,644 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(877)) - Get metadata for subqueries 2011-04-29 11:10:13,644 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(884)) - Get metadata for destination tables 2011-04-29 11:10:13,645 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6795)) - Completed getting MetaData in Semantic Analysis 2011-04-29 11:10:13,646 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(5962)) - Created Table Plan for default__temp_temp_index__ org.apache.hadoop.hive.ql.exec.TableScanOperator@2ce3a2bb 2011-04-29 11:10:13,648 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFilterPlan(1403)) - Created Filter Plan for null row schema: default__temp_temp_index__{(key,key: string)(_bucketname,_bucketname: string)(_offsets,_offsets: array)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:13,648 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1933)) - tree: (TOK_SELECT (TOK_SELEXPR TOK_ALLCOLREF)) 2011-04-29 11:10:13,648 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2034)) - genSelectPlan: input = default__temp_temp_index__{(key,key: string)(_bucketname,_bucketname: string)(_offsets,_offsets: array)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:13,649 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2151)) - Created Select Plan row schema: default__temp_temp_index__{(key,_col0: string)(_bucketname,_col1: string)(_offsets,_col2: array)} 2011-04-29 11:10:13,649 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1922)) - Created Select Plan for clause: insclause-0 2011-04-29 11:10:13,650 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1, _col2] columnTypes=[string, string, array] separator=[[B@6647dc79] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:13,650 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1, _col2] columnTypes=[string, string, array] separator=[[B@77dbc064] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:13,651 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(3877)) - Created FileSink Plan for clause: insclause-0dest_path: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-13_591_6232015675419354139/-mr-10000 row schema: default__temp_temp_index__{(key,_col0: string)(_bucketname,_col1: string)(_offsets,_col2: array)} 2011-04-29 11:10:13,651 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(5560)) - Created Body Plan for Query Block null 2011-04-29 11:10:13,651 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(6079)) - Created Plan for Query Block null 2011-04-29 11:10:13,653 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for FS(3) 2011-04-29 11:10:13,653 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(2) 2011-04-29 11:10:13,662 INFO ppd.OpProcFactory (OpProcFactory.java:process(144)) - Processing for FIL(1) 2011-04-29 11:10:13,664 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of FIL For Alias : default__temp_temp_index__ 2011-04-29 11:10:13,665 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:13,665 INFO ppd.OpProcFactory (OpProcFactory.java:process(124)) - Processing for TS(0) 2011-04-29 11:10:13,666 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of TS For Alias : default__temp_temp_index__ 2011-04-29 11:10:13,667 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:13,668 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(168)) - Started pruning partiton 2011-04-29 11:10:13,668 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(169)) - dbname = default 2011-04-29 11:10:13,668 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(170)) - tabname = default__temp_temp_index__ 2011-04-29 11:10:13,669 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(171)) - prune Expression = class org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPAnd(Const boolean null, Const boolean null() 2011-04-29 11:10:13,672 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:13,672 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:13,673 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@7b839aa9] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:13,673 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:13,673 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(692)) - Adding pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ of tabledefault__temp_temp_index__ 2011-04-29 11:10:13,674 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(725)) - Information added for path pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ 2011-04-29 11:10:13,674 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:13,675 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:13,677 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:13,678 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:13,678 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6833)) - Completed plan generation 2011-04-29 11:10:13,678 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:13,693 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.DelimitedJSONSerDe initialized with: columnNames=[] columnTypes=[] separator=[[B@5d7c1cf0] nullstring=NULL lastColumnTakesRest=false 2011-04-29 11:10:13,706 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:key, type:string, comment:null), FieldSchema(name:_bucketname, type:string, comment:null), FieldSchema(name:_offsets, type:array, comment:null)], properties:null) 2011-04-29 11:10:13,707 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.DelimitedJSONSerDe initialized with: columnNames=[] columnTypes=[] separator=[[B@284876e0] nullstring=NULL lastColumnTakesRest=false 2011-04-29 11:10:13,707 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:13,708 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:13,708 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0015 2011-04-29 11:10:13,708 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0015 2011-04-29 11:10:13,709 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0015 2011-04-29 11:10:13,710 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0015 type:closeSession cxid:0x13 zxid:0xc8 txntype:-11 reqpath:n/a 2011-04-29 11:10:13,710 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0015 type:closeSession cxid:0x13 zxid:0xc8 txntype:-11 reqpath:n/a 2011-04-29 11:10:13,711 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0015, packet:: clientPath:null serverPath:null finished:false header:: 19,-11 replyHeader:: 19,200,0 request:: null response:: null 2011-04-29 11:10:13,711 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0015 2011-04-29 11:10:13,711 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56326 which had sessionid 0x12fa2738adb0015 2011-04-29 11:10:13,711 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0015 closed 2011-04-29 11:10:13,712 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1458)) - ignoring exception during input shutdown java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.server.NIOServerCnxn.closeSock(NIOServerCnxn.java:1454) at org.apache.zookeeper.server.NIOServerCnxn.close(NIOServerCnxn.java:1411) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:631) at org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:261) 2011-04-29 11:10:13,712 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@6ddb6b07 2011-04-29 11:10:13,713 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:10:13,715 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/0:0:0:0:0:0:0:1:21818, initiating session 2011-04-29 11:10:13,715 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /0:0:0:0:0:0:0:1%0:56327 2011-04-29 11:10:13,715 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:10:13,716 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /0:0:0:0:0:0:0:1%0:56327 client's lastZxid is 0x0 2011-04-29 11:10:13,716 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /0:0:0:0:0:0:0:1%0:56327 2011-04-29 11:10:13,717 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:createSession cxid:0x0 zxid:0xc9 txntype:-10 reqpath:n/a 2011-04-29 11:10:13,717 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:createSession cxid:0x0 zxid:0xc9 txntype:-10 reqpath:n/a 2011-04-29 11:10:13,718 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0016 with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1%0:56327 2011-04-29 11:10:13,718 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21818, sessionid = 0x12fa2738adb0016, negotiated timeout = 40000 2011-04-29 11:10:13,719 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:create cxid:0x1 zxid:0xca txntype:1 reqpath:n/a 2011-04-29 11:10:13,720 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:create cxid:0x1 zxid:0xca txntype:1 reqpath:n/a 2011-04-29 11:10:13,720 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,202,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:10:13,722 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:create cxid:0x2 zxid:0xcb txntype:1 reqpath:n/a 2011-04-29 11:10:13,722 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:create cxid:0x2 zxid:0xcb txntype:1 reqpath:n/a 2011-04-29 11:10:13,723 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,203,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f33643935366433362d623232662d343436362d613932342d6137326561633661353862353a313330343130303631333730383a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:10:13,723 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:13,724 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:13,724 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,203,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:13,726 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:create cxid:0x4 zxid:0xcc txntype:1 reqpath:n/a 2011-04-29 11:10:13,726 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:create cxid:0x4 zxid:0xcc txntype:1 reqpath:n/a 2011-04-29 11:10:13,727 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,204,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:13,728 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:create cxid:0x5 zxid:0xcd txntype:1 reqpath:n/a 2011-04-29 11:10:13,728 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:create cxid:0x5 zxid:0xcd txntype:1 reqpath:n/a 2011-04-29 11:10:13,729 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,205,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f33643935366433362d623232662d343436362d613932342d6137326561633661353862353a313330343130303631333730383a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-SHARED-0000000000 2011-04-29 11:10:13,729 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:13,730 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:13,730 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,205,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:13,731 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:13,731 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:13,731 INFO ql.Driver (Driver.java:execute(972)) - Starting command: -- query should not return any values greater than 50 SELECT * FROM default__temp_temp_index__ WHERE key > 45 AND key < 55 2011-04-29 11:10:13,732 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:13,733 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: -- query should not return any values greater than 50 SELECT * FROM default__temp_temp_index__ WHERE key > 45 AND key < 55 2011-04-29 11:10:13,733 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: QUERY 2011-04-29 11:10:13,733 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Input: default@default__temp_temp_index__ 2011-04-29 11:10:13,733 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-13_591_6232015675419354139/-mr-10000 2011-04-29 11:10:13,734 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:13,734 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:13,734 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:13,734 INFO ql.Driver (SessionState.java:printInfo(365)) - Total MapReduce jobs = 1 2011-04-29 11:10:13,735 INFO ql.Driver (SessionState.java:printInfo(365)) - Launching Job 1 out of 1 2011-04-29 11:10:13,736 INFO exec.MapRedTask (SessionState.java:printInfo(365)) - Number of reduce tasks is set to 0 since there's no reduce operator 2011-04-29 11:10:13,776 INFO exec.MapRedTask (MapRedTask.java:execute(161)) - Generating plan file file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-13_591_6232015675419354139/-local-10002/plan.xml 2011-04-29 11:10:13,877 INFO exec.MapRedTask (MapRedTask.java:execute(198)) - Executing: /Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/bin/hadoop jar /Users/rmelick/hive/build/ql/hive-exec-0.8.0-SNAPSHOT.jar org.apache.hadoop.hive.ql.exec.ExecDriver -libjars file:///Users/rmelick/hive/build/ql/test/test-udfs.jar -plan file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-13_591_6232015675419354139/-local-10002/plan.xml -nolog -jobconf hive.stats.jdbcdriver=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.aux.jars.path=file%3A%2F%2F%2FUsers%2Frmelick%2Fhive%2Fbuild%2Fql%2Ftest%2Ftest-udfs.jar -jobconf hive.mapjoin.followby.gby.localtask.max.memory.usage=0.55 -jobconf hive.limit.optimize.limit.file=10 -jobconf datanucleus.validateColumns=false -jobconf datanucleus.connectionPoolingType=DBCP -jobconf hadoop.tmp.dir=%24%7Bbuild.dir.hive%7D%2Ftest%2Fhadoop-%24%7Buser.name%7D -jobconf test.src.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Fsrc%2Ftest -jobconf hive.variable.substitute=true -jobconf hive.stats.dbclass=jdbc%3Aderby -jobconf hive.lock.mapred.only.operation=false -jobconf hive.script.serde=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe -jobconf hive.merge.smallfiles.avgsize=16000000 -jobconf datanucleus.cache.level2=false -jobconf hive.hbase.wal.enabled=true -jobconf hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider -jobconf hive.metastore.rawstore.impl=org.apache.hadoop.hive.metastore.ObjectStore -jobconf hive.metastore.local=true -jobconf hive.optimize.ppd.storage=true -jobconf hive.querylog.location=%24%7Bbuild.dir%7D%2Ftmp -jobconf hive.limit.row.max.size=100000 -jobconf hive.rework.mapredwork=false -jobconf hive.added.jars.path= -jobconf hive.metastore.authorization.storage.checks=false -jobconf hive.zookeeper.namespace=hive_zookeeper_namespace -jobconf hive.test.mode.prefix=test_ -jobconf hive.test.mode=false -jobconf hive.exec.compress.intermediate=false -jobconf datanucleus.cache.level2.type=SOFT -jobconf hive.metastore.ds.retry.attempts=1 -jobconf hive.limit.optimize.enable=false -jobconf hive.zookeeper.client.port=21818 -jobconf javax.jdo.option.ConnectionUserName=APP -jobconf hive.merge.mapfiles=true -jobconf hive.test.mode.samplefreq=32 -jobconf hive.optimize.skewjoin=false -jobconf hive.metastore.server.min.threads=200 -jobconf hive.mapjoin.localtask.max.memory.usage=0.90 -jobconf hive.map.aggr.hash.min.reduction=0.5 -jobconf hive.exec.compress.output=false -jobconf hive.script.recordreader=org.apache.hadoop.hive.ql.exec.TextRecordReader -jobconf javax.jdo.option.Multithreaded=true -jobconf hive.exec.post.hooks=org.apache.hadoop.hive.ql.hooks.PostExecutePrinter -jobconf hive.lock.numretries=100 -jobconf hive.exec.parallel.thread.number=8 -jobconf hive.exec.max.created.files=100000 -jobconf hive.exec.default.partition.name=__HIVE_DEFAULT_PARTITION__ -jobconf test.log.dir=%24%7Bbuild.dir%7D%2Ftest%2Flogs -jobconf hive.archive.har.parentdir.settable=false -jobconf hive.exec.pre.hooks=org.apache.hadoop.hive.ql.hooks.PreExecutePrinter%2C+org.apache.hadoop.hive.ql.hooks.EnforceReadOnlyTables -jobconf hive.exec.mode.local.auto=false -jobconf hive.optimize.index.filter=true -jobconf datanucleus.storeManagerType=rdbms -jobconf hive.script.operator.id.env.var=HIVE_SCRIPT_OPERATOR_ID -jobconf hive.metastore.ds.retry.interval=1000 -jobconf hive.skewjoin.mapjoin.min.split=33554432 -jobconf hive.metastore.client.connect.retry.delay=1 -jobconf hive.auto.convert.join=false -jobconf hive.metastore.warehouse.dir=%24%7Btest.warehouse.dir%7D -jobconf hive.mapjoin.bucket.cache.size=100 -jobconf datanucleus.transactionIsolation=read-committed -jobconf hive.stats.jdbc.timeout=30 -jobconf hive.concurrency.manager=org.apache.hadoop.hive.ql.lockmgr.ZooKeeperLockMgr -jobconf hive.mergejob.maponly=true -jobconf hive.fetch.output.serde=org.apache.hadoop.hive.serde2.DelimitedJSONSerDe -jobconf hive.mapjoin.followby.map.aggr.hash.percentmemory=0.3 -jobconf hive.exim.uri.scheme.whitelist=hdfs%2Cpfile -jobconf hive.stats.dbconnectionstring=jdbc%3Aderby%3A%3BdatabaseName%3DTempStatsStore%3Bcreate%3Dtrue -jobconf mapred.reduce.tasks=-1 -jobconf hive.optimize.index.filter.compact.minsize=0 -jobconf hive.skewjoin.key=100000 -jobconf javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.DummyAuthenticator -jobconf hive.udtf.auto.progress=false -jobconf hive.session.id=rmelick_201104291109 -jobconf mapred.job.name=--+query+should+not+return+any+values+g...55%28Stage-1%29 -jobconf hive.exec.script.maxerrsize=100000 -jobconf hive.optimize.groupby=true -jobconf datanucleus.plugin.pluginRegistryBundleCheck=LOG -jobconf hive.exec.rowoffset=false -jobconf hive.default.fileformat=TextFile -jobconf hive.mapjoin.smalltable.filesize=25000000 -jobconf hive.exec.scratchdir=%24%7Bbuild.dir%7D%2Fscratchdir -jobconf datanucleus.identifierFactory=datanucleus -jobconf hive.exec.max.dynamic.partitions.pernode=100 -jobconf hive.join.emit.interval=1000 -jobconf hive.script.recordwriter=org.apache.hadoop.hive.ql.exec.TextRecordWriter -jobconf datanucleus.validateConstraints=false -jobconf hive.exec.dynamic.partition=false -jobconf hive.optimize.index.filter.compact.maxsize=-1 -jobconf hive.metastore.client.socket.timeout=20 -jobconf hive.map.aggr.hash.force.flush.memory.threshold=0.9 -jobconf hive.exec.show.job.failure.debug.info=false -jobconf hive.join.cache.size=25000 -jobconf datanucleus.autoStartMechanismMode=checked -jobconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat -jobconf hive.skewjoin.mapjoin.map.tasks=10000 -jobconf hive.exec.drop.ignorenonexistent=true -jobconf hive.hwi.listen.port=9999 -jobconf hive.session.silent=true -jobconf hive.cli.print.header=false -jobconf hive.groupby.mapaggr.checkinterval=100000 -jobconf hive.metastore.server.max.threads=100000 -jobconf hive.metastore.kerberos.principal=hive-metastore%2F_HOST%40EXAMPLE.COM -jobconf javax.jdo.option.ConnectionURL=jdbc%3Aderby%3A%3BdatabaseName%3D..%2Fbuild%2Ftest%2Fjunit_metastore_db%3Bcreate%3Dtrue -jobconf hive.mapred.mode=nonstrict -jobconf hive.metastore.batch.retrieve.max=300 -jobconf hive.groupby.skewindata=false -jobconf hive.exec.parallel=false -jobconf hive.zookeeper.clean.extra.nodes=false -jobconf test.data.files=%24%7Buser.dir%7D%2F..%2Fdata%2Ffiles -jobconf hive.merge.size.per.task=256000000 -jobconf fs.har.impl=org.apache.hadoop.hive.shims.HiveHarFileSystem -jobconf hive.exec.reducers.max=999 -jobconf fs.pfile.impl=org.apache.hadoop.fs.ProxyLocalFileSystem -jobconf hive.query.string=%0A%0A--+query+should+not+return+any+values+greater+than+50%0ASELECT+*+FROM+default__temp_temp_index__+WHERE+key+%3E+45+AND+key+%3C+55 -jobconf hive.optimize.ppd=true -jobconf hive.metastore.cache.pinobjtypes=Table%2CStorageDescriptor%2CSerDeInfo%2CPartition%2CDatabase%2CType%2CFieldSchema%2COrder -jobconf hive.mapjoin.hashtable.initialCapacity=100000 -jobconf hive.jar.path=%24%7Bbuild.dir.hive%7D%2Fql%2Fhive-exec-%24%7Bversion%7D.jar -jobconf hive.mapjoin.cache.numrows=25000 -jobconf hive.merge.mapredfiles=false -jobconf hive.metastore.sasl.enabled=false -jobconf hive.fileformat.check=true -jobconf hive.metastore.connect.retries=5 -jobconf hive.query.id=rmelick_20110429111010_3d956d36-b22f-4466-a924-a72eac6a58b5 -jobconf hive.zookeeper.quorum=localhost -jobconf javax.jdo.option.DetachAllOnCommit=true -jobconf hive.metastore.metadb.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Ftest%2Fdata%2Fmetadb%2F -jobconf javax.jdo.option.ConnectionPassword=mine -jobconf hive.optimize.pruner=true -jobconf hive.optimize.reducededuplication=true -jobconf hive.hwi.listen.host=0.0.0.0 -jobconf hive.index.compact.file.ignore.hdfs=false -jobconf hive.auto.progress.timeout=0 -jobconf hive.map.aggr.hash.percentmemory=0.5 -jobconf hive.mapjoin.check.memory.rows=100000 -jobconf javax.jdo.PersistenceManagerFactoryClass=org.datanucleus.jdo.JDOPersistenceManagerFactory -jobconf hive.mapred.local.mem=0 -jobconf datanucleus.validateTables=false -jobconf hive.exec.max.dynamic.partitions=1000 -jobconf hive.stats.jdbc.atomic=false -jobconf hive.exec.dynamic.partition.mode=strict -jobconf hive.hwi.war.file=lib%2Fhive-hwi-%40VERSION%40.war -jobconf hive.script.auto.progress=false -jobconf hive.lock.sleep.between.retries=60 -jobconf hive.enforce.sorting=false -jobconf datanucleus.autoCreateSchema=true -jobconf hive.task.progress=false -jobconf hive.metastore.server.tcp.keepalive=true -jobconf hive.stats.autogather=true -jobconf hive.map.aggr=true -jobconf hive.enforce.bucketing=false -jobconf hive.limit.optimize.fetch.max=50000 -jobconf hive.exec.script.allow.partial.consumption=false -jobconf hive.archive.enabled=false -jobconf hive.support.concurrency=true -jobconf hive.mapjoin.hashtable.loadfactor=0.75 -jobconf hive.mapred.reduce.tasks.speculative.execution=true -jobconf hive.heartbeat.interval=1000 -jobconf hive.exec.counters.pull.interval=1000 -jobconf hive.mapjoin.maxsize=100000 -jobconf javax.jdo.option.NonTransactionalRead=true -jobconf hive.optimize.cp=true -jobconf hive.exec.reducers.bytes.per.reducer=1000000000 -jobconf test.query.file1=file%3A%2F%2F%24%7Buser.dir%7D%2F..%2Fql%2Fsrc%2Ftest%2Forg%2Fapache%2Fhadoop%2Fhive%2Fql%2Finput2.q -jobconf hive.error.on.empty.partition=false -jobconf hive.security.authorization.enabled=false -jobconf mapred.system.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Fsystem%2F-1762007737 -jobconf mapred.local.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Flocal%2F1604000734 2011-04-29 11:10:18,771 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:18,772 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:18,772 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(721)) - Got ping response for sessionid: 0x12fa2738adb0010 after 2ms 2011-04-29 11:10:19,129 INFO exec.MapRedTask (MapRedTask.java:execute(266)) - Execution completed successfully 2011-04-29 11:10:19,130 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,130 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: -- query should not return any values greater than 50 SELECT * FROM default__temp_temp_index__ WHERE key > 45 AND key < 55 2011-04-29 11:10:19,131 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: QUERY 2011-04-29 11:10:19,131 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Input: default@default__temp_temp_index__ 2011-04-29 11:10:19,131 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-13_591_6232015675419354139/-mr-10000 2011-04-29 11:10:19,132 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._bucketname SIMPLE [(temp)temp.FieldSchema(name:INPUT__FILE__NAME, type:string, comment:), ] 2011-04-29 11:10:19,132 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._offsets EXPRESSION [(temp)temp.FieldSchema(name:BLOCK__OFFSET__INSIDE__FILE, type:bigint, comment:), ] 2011-04-29 11:10:19,132 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__.key SIMPLE [(temp)temp.FieldSchema(name:key, type:string, comment:null), ] 2011-04-29 11:10:19,132 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:19,133 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:19,133 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:19,133 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:19,133 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,134 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,134 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:10:19,134 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,136 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:delete cxid:0x7 zxid:0xce txntype:2 reqpath:n/a 2011-04-29 11:10:19,136 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:delete cxid:0x7 zxid:0xce txntype:2 reqpath:n/a 2011-04-29 11:10:19,137 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,206,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:19,138 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:19,138 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:19,138 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,206,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,F response:: v{} 2011-04-29 11:10:19,139 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:delete cxid:0x9 zxid:0xcf txntype:2 reqpath:n/a 2011-04-29 11:10:19,140 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:delete cxid:0x9 zxid:0xcf txntype:2 reqpath:n/a 2011-04-29 11:10:19,140 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,207,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,-1 response:: null 2011-04-29 11:10:19,141 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:delete cxid:0xa zxid:0xd0 txntype:2 reqpath:n/a 2011-04-29 11:10:19,142 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:delete cxid:0xa zxid:0xd0 txntype:2 reqpath:n/a 2011-04-29 11:10:19,142 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,208,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:19,142 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:19,143 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:19,143 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,208,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:10:19,144 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:delete cxid:0xc zxid:0xd1 txntype:2 reqpath:n/a 2011-04-29 11:10:19,144 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:delete cxid:0xc zxid:0xd1 txntype:2 reqpath:n/a 2011-04-29 11:10:19,145 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,209,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:10:19,145 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,161 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0011 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:19,162 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0011 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:19,162 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(721)) - Got ping response for sessionid: 0x12fa2738adb0011 after 1ms 2011-04-29 11:10:19,197 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1 2011-04-29 11:10:19,250 DEBUG mapred.FileInputFormat (FileInputFormat.java:getSplits(248)) - Total # of splits: 1 2011-04-29 11:10:19,251 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1, _col2] columnTypes=[string, string, array] separator=[[B@1e8a5cf3] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,252 DEBUG exec.FetchOperator (FetchOperator.java:getRecordReader(287)) - Creating fetchTask with deserializer typeinfo: struct<_col0:string,_col1:string,_col2:array> 2011-04-29 11:10:19,252 DEBUG exec.FetchOperator (FetchOperator.java:getRecordReader(289)) - deserializer properties: {columns=_col0,_col1,_col2, serialization.format=1, columns.types=string:string:array} 2011-04-29 11:10:19,306 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 5.716 seconds 2011-04-29 11:10:19,306 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,307 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: EXPLAIN SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:19,308 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: EXPLAIN SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:19,323 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:10:19,324 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:10:19,324 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6792)) - Completed phase 1 of Semantic Analysis 2011-04-29 11:10:19,325 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(816)) - Get metadata for source tables 2011-04-29 11:10:19,325 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:19,345 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:19,345 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@fc77f54] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,345 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(877)) - Get metadata for subqueries 2011-04-29 11:10:19,346 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(884)) - Get metadata for destination tables 2011-04-29 11:10:19,346 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6795)) - Completed getting MetaData in Semantic Analysis 2011-04-29 11:10:19,346 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(5962)) - Created Table Plan for temp org.apache.hadoop.hive.ql.exec.TableScanOperator@72786be3 2011-04-29 11:10:19,348 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFilterPlan(1403)) - Created Filter Plan for null row schema: temp{(key,key: string)(val,val: string)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:19,348 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1933)) - tree: (TOK_SELECT (TOK_SELEXPR TOK_ALLCOLREF)) 2011-04-29 11:10:19,349 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2034)) - genSelectPlan: input = temp{(key,key: string)(val,val: string)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:19,349 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2151)) - Created Select Plan row schema: temp{(key,_col0: string)(val,_col1: string)} 2011-04-29 11:10:19,349 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1922)) - Created Select Plan for clause: insclause-0 2011-04-29 11:10:19,350 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, string] separator=[[B@a62e15c] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,350 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, string] separator=[[B@61b96457] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,351 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(3877)) - Created FileSink Plan for clause: insclause-0dest_path: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_308_1369552315876283709/-mr-10000 row schema: temp{(key,_col0: string)(val,_col1: string)} 2011-04-29 11:10:19,351 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(5560)) - Created Body Plan for Query Block null 2011-04-29 11:10:19,351 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(6079)) - Created Plan for Query Block null 2011-04-29 11:10:19,352 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for FS(3) 2011-04-29 11:10:19,353 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(2) 2011-04-29 11:10:19,353 INFO ppd.OpProcFactory (OpProcFactory.java:process(144)) - Processing for FIL(1) 2011-04-29 11:10:19,354 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of FIL For Alias : temp 2011-04-29 11:10:19,354 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:19,354 INFO ppd.OpProcFactory (OpProcFactory.java:process(124)) - Processing for TS(0) 2011-04-29 11:10:19,355 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of TS For Alias : temp 2011-04-29 11:10:19,356 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:19,357 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(168)) - Started pruning partiton 2011-04-29 11:10:19,357 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(169)) - dbname = default 2011-04-29 11:10:19,357 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(170)) - tabname = temp 2011-04-29 11:10:19,357 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(171)) - prune Expression = class org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPAnd(Const boolean null, Const boolean null() 2011-04-29 11:10:19,359 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:19,360 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:19,360 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@6e1513f3] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,360 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:19,361 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(692)) - Adding pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp of tabletemp 2011-04-29 11:10:19,361 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(725)) - Information added for path pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp 2011-04-29 11:10:19,362 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=temp 2011-04-29 11:10:19,362 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:19,365 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:19,368 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:19,398 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:19,434 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,434 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@512190b1] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,513 INFO exec.Utilities (Utilities.java:getInputSummary(1704)) - Cache Content Summary for pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp length: 5812 file count: 1 directory count: 1 2011-04-29 11:10:19,521 INFO compact.CompactIndexHandler (CompactIndexHandler.java:generateIndexQuery(173)) - Generating tasks for re-entrant QL query: INSERT OVERWRITE DIRECTORY "file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_308_1369552315876283709/-mr-10002" SELECT `_bucketname` , `_offsets` FROM `default__temp_temp_index__` WHERE ((key > 45) and (key < 55)) 2011-04-29 11:10:19,521 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,521 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: INSERT OVERWRITE DIRECTORY "file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_308_1369552315876283709/-mr-10002" SELECT `_bucketname` , `_offsets` FROM `default__temp_temp_index__` WHERE ((key > 45) and (key < 55)) 2011-04-29 11:10:19,522 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: INSERT OVERWRITE DIRECTORY "file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_308_1369552315876283709/-mr-10002" SELECT `_bucketname` , `_offsets` FROM `default__temp_temp_index__` WHERE ((key > 45) and (key < 55)) 2011-04-29 11:10:19,525 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:10:19,526 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:10:19,526 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6792)) - Completed phase 1 of Semantic Analysis 2011-04-29 11:10:19,526 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(816)) - Get metadata for source tables 2011-04-29 11:10:19,527 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:19,548 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,549 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@6522d847] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,550 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(877)) - Get metadata for subqueries 2011-04-29 11:10:19,550 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(884)) - Get metadata for destination tables 2011-04-29 11:10:19,550 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6795)) - Completed getting MetaData in Semantic Analysis 2011-04-29 11:10:19,551 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(5962)) - Created Table Plan for default__temp_temp_index__ org.apache.hadoop.hive.ql.exec.TableScanOperator@52a55130 2011-04-29 11:10:19,552 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFilterPlan(1403)) - Created Filter Plan for null row schema: default__temp_temp_index__{(key,key: string)(_bucketname,_bucketname: string)(_offsets,_offsets: array)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:19,553 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1933)) - tree: (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL `_bucketname`)) (TOK_SELEXPR (TOK_TABLE_OR_COL `_offsets`))) 2011-04-29 11:10:19,553 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2034)) - genSelectPlan: input = default__temp_temp_index__{(key,key: string)(_bucketname,_bucketname: string)(_offsets,_offsets: array)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:19,554 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2151)) - Created Select Plan row schema: null{(`_bucketname`,_col0: string)(`_offsets`,_col1: array)} 2011-04-29 11:10:19,554 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1922)) - Created Select Plan for clause: insclause-0 2011-04-29 11:10:19,555 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, array] separator=[[B@31b037fe] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,556 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, array] separator=[[B@282c1e2e] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,556 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(3877)) - Created FileSink Plan for clause: insclause-0dest_path: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_308_1369552315876283709/-mr-10002 row schema: null{(`_bucketname`,_col0: string)(`_offsets`,_col1: array)} 2011-04-29 11:10:19,556 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(5560)) - Created Body Plan for Query Block null 2011-04-29 11:10:19,557 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(6079)) - Created Plan for Query Block null 2011-04-29 11:10:19,558 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for FS(8) 2011-04-29 11:10:19,559 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(7) 2011-04-29 11:10:19,559 INFO ppd.OpProcFactory (OpProcFactory.java:process(144)) - Processing for FIL(6) 2011-04-29 11:10:19,560 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of FIL For Alias : default__temp_temp_index__ 2011-04-29 11:10:19,560 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:19,560 INFO ppd.OpProcFactory (OpProcFactory.java:process(124)) - Processing for TS(5) 2011-04-29 11:10:19,561 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of TS For Alias : default__temp_temp_index__ 2011-04-29 11:10:19,562 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:19,563 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(168)) - Started pruning partiton 2011-04-29 11:10:19,563 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(169)) - dbname = default 2011-04-29 11:10:19,563 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(170)) - tabname = default__temp_temp_index__ 2011-04-29 11:10:19,564 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(171)) - prune Expression = class org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPAnd(Const boolean null, Const boolean null() 2011-04-29 11:10:19,566 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,566 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,567 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@4b43cc20] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,567 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,568 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(692)) - Adding pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ of tabledefault__temp_temp_index__ 2011-04-29 11:10:19,568 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(725)) - Information added for path pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ 2011-04-29 11:10:19,569 INFO optimizer.GenMRFileSink1 (GenMRFileSink1.java:createMergeJob(279)) - use CombineHiveInputformat for the merge job 2011-04-29 11:10:19,569 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:19,570 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:19,573 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:19,573 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:19,574 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:19,574 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:19,577 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:19,577 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:19,578 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6833)) - Completed plan generation 2011-04-29 11:10:19,578 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:19,579 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:`_bucketname`, type:string, comment:null), FieldSchema(name:`_offsets`, type:array, comment:null)], properties:null) 2011-04-29 11:10:19,580 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,590 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6833)) - Completed plan generation 2011-04-29 11:10:19,591 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:19,592 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:10:19,592 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,592 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,592 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,593 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,593 INFO ql.Driver (Driver.java:execute(972)) - Starting command: EXPLAIN SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:19,593 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,594 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: EXPLAIN SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:19,594 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: QUERY 2011-04-29 11:10:19,594 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,594 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,595 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,681 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,681 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: EXPLAIN SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:19,681 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: QUERY 2011-04-29 11:10:19,682 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._bucketname SIMPLE [(temp)temp.FieldSchema(name:INPUT__FILE__NAME, type:string, comment:), ] 2011-04-29 11:10:19,682 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._offsets EXPRESSION [(temp)temp.FieldSchema(name:BLOCK__OFFSET__INSIDE__FILE, type:bigint, comment:), ] 2011-04-29 11:10:19,682 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__.key SIMPLE [(temp)temp.FieldSchema(name:key, type:string, comment:null), ] 2011-04-29 11:10:19,683 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:19,683 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:19,683 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:19,683 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:19,684 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,684 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,684 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:10:19,685 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,685 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,693 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 0.387 seconds 2011-04-29 11:10:19,693 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,694 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:19,694 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:19,696 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:10:19,696 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:10:19,696 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6792)) - Completed phase 1 of Semantic Analysis 2011-04-29 11:10:19,696 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(816)) - Get metadata for source tables 2011-04-29 11:10:19,697 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:19,738 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:19,739 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@7c1ca8e] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,739 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(877)) - Get metadata for subqueries 2011-04-29 11:10:19,739 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(884)) - Get metadata for destination tables 2011-04-29 11:10:19,740 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6795)) - Completed getting MetaData in Semantic Analysis 2011-04-29 11:10:19,741 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(5962)) - Created Table Plan for temp org.apache.hadoop.hive.ql.exec.TableScanOperator@43d9349c 2011-04-29 11:10:19,742 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFilterPlan(1403)) - Created Filter Plan for null row schema: temp{(key,key: string)(val,val: string)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:19,742 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1933)) - tree: (TOK_SELECT (TOK_SELEXPR TOK_ALLCOLREF)) 2011-04-29 11:10:19,743 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2034)) - genSelectPlan: input = temp{(key,key: string)(val,val: string)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:19,743 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2151)) - Created Select Plan row schema: temp{(key,_col0: string)(val,_col1: string)} 2011-04-29 11:10:19,743 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1922)) - Created Select Plan for clause: insclause-0 2011-04-29 11:10:19,744 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, string] separator=[[B@1c23cae6] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,744 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, string] separator=[[B@71ddd078] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,744 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(3877)) - Created FileSink Plan for clause: insclause-0dest_path: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-mr-10000 row schema: temp{(key,_col0: string)(val,_col1: string)} 2011-04-29 11:10:19,745 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(5560)) - Created Body Plan for Query Block null 2011-04-29 11:10:19,745 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(6079)) - Created Plan for Query Block null 2011-04-29 11:10:19,746 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for FS(3) 2011-04-29 11:10:19,746 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(2) 2011-04-29 11:10:19,747 INFO ppd.OpProcFactory (OpProcFactory.java:process(144)) - Processing for FIL(1) 2011-04-29 11:10:19,747 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of FIL For Alias : temp 2011-04-29 11:10:19,748 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:19,748 INFO ppd.OpProcFactory (OpProcFactory.java:process(124)) - Processing for TS(0) 2011-04-29 11:10:19,749 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of TS For Alias : temp 2011-04-29 11:10:19,749 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:19,750 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(168)) - Started pruning partiton 2011-04-29 11:10:19,750 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(169)) - dbname = default 2011-04-29 11:10:19,750 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(170)) - tabname = temp 2011-04-29 11:10:19,751 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(171)) - prune Expression = class org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPAnd(Const boolean null, Const boolean null() 2011-04-29 11:10:19,753 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:19,753 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:19,753 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@7c564448] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,754 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:19,754 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(692)) - Adding pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp of tabletemp 2011-04-29 11:10:19,754 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(725)) - Information added for path pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp 2011-04-29 11:10:19,755 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=temp 2011-04-29 11:10:19,755 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:19,758 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:19,761 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:19,771 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:19,785 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,786 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@586ca3ef] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,859 INFO exec.Utilities (Utilities.java:getInputSummary(1704)) - Cache Content Summary for pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp length: 5812 file count: 1 directory count: 1 2011-04-29 11:10:19,860 INFO compact.CompactIndexHandler (CompactIndexHandler.java:generateIndexQuery(173)) - Generating tasks for re-entrant QL query: INSERT OVERWRITE DIRECTORY "file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-mr-10002" SELECT `_bucketname` , `_offsets` FROM `default__temp_temp_index__` WHERE ((key > 45) and (key < 55)) 2011-04-29 11:10:19,861 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,861 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: INSERT OVERWRITE DIRECTORY "file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-mr-10002" SELECT `_bucketname` , `_offsets` FROM `default__temp_temp_index__` WHERE ((key > 45) and (key < 55)) 2011-04-29 11:10:19,862 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: INSERT OVERWRITE DIRECTORY "file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-mr-10002" SELECT `_bucketname` , `_offsets` FROM `default__temp_temp_index__` WHERE ((key > 45) and (key < 55)) 2011-04-29 11:10:19,864 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:10:19,865 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6767)) - Starting Semantic Analysis 2011-04-29 11:10:19,866 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6792)) - Completed phase 1 of Semantic Analysis 2011-04-29 11:10:19,866 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(816)) - Get metadata for source tables 2011-04-29 11:10:19,866 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:19,896 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,897 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@4732a704] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,897 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(877)) - Get metadata for subqueries 2011-04-29 11:10:19,898 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(884)) - Get metadata for destination tables 2011-04-29 11:10:19,898 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6795)) - Completed getting MetaData in Semantic Analysis 2011-04-29 11:10:19,898 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(5962)) - Created Table Plan for default__temp_temp_index__ org.apache.hadoop.hive.ql.exec.TableScanOperator@4e731c20 2011-04-29 11:10:19,900 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFilterPlan(1403)) - Created Filter Plan for null row schema: default__temp_temp_index__{(key,key: string)(_bucketname,_bucketname: string)(_offsets,_offsets: array)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:19,900 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1933)) - tree: (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL `_bucketname`)) (TOK_SELEXPR (TOK_TABLE_OR_COL `_offsets`))) 2011-04-29 11:10:19,901 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2034)) - genSelectPlan: input = default__temp_temp_index__{(key,key: string)(_bucketname,_bucketname: string)(_offsets,_offsets: array)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)} 2011-04-29 11:10:19,901 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(2151)) - Created Select Plan row schema: null{(`_bucketname`,_col0: string)(`_offsets`,_col1: array)} 2011-04-29 11:10:19,902 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(1922)) - Created Select Plan for clause: insclause-0 2011-04-29 11:10:19,903 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, array] separator=[[B@3dd261e0] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,903 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, array] separator=[[B@3f17d8d5] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,904 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(3877)) - Created FileSink Plan for clause: insclause-0dest_path: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-mr-10002 row schema: null{(`_bucketname`,_col0: string)(`_offsets`,_col1: array)} 2011-04-29 11:10:19,904 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(5560)) - Created Body Plan for Query Block null 2011-04-29 11:10:19,905 DEBUG parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(6079)) - Created Plan for Query Block null 2011-04-29 11:10:19,907 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for FS(8) 2011-04-29 11:10:19,907 INFO ppd.OpProcFactory (OpProcFactory.java:process(284)) - Processing for SEL(7) 2011-04-29 11:10:19,907 INFO ppd.OpProcFactory (OpProcFactory.java:process(144)) - Processing for FIL(6) 2011-04-29 11:10:19,908 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of FIL For Alias : default__temp_temp_index__ 2011-04-29 11:10:19,909 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:19,909 INFO ppd.OpProcFactory (OpProcFactory.java:process(124)) - Processing for TS(5) 2011-04-29 11:10:19,910 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(297)) - Pushdown Predicates of TS For Alias : default__temp_temp_index__ 2011-04-29 11:10:19,910 INFO ppd.OpProcFactory (OpProcFactory.java:logExpr(300)) - ((key > 45) and (key < 55)) 2011-04-29 11:10:19,912 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(168)) - Started pruning partiton 2011-04-29 11:10:19,913 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(169)) - dbname = default 2011-04-29 11:10:19,913 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(170)) - tabname = default__temp_temp_index__ 2011-04-29 11:10:19,914 DEBUG ppr.PartitionPruner (PartitionPruner.java:prune(171)) - prune Expression = class org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPAnd(Const boolean null, Const boolean null() 2011-04-29 11:10:19,916 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,917 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,917 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, _bucketname, _offsets] columnTypes=[string, string, array] separator=[[B@629609cc] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:19,918 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct default__temp_temp_index__ { string key, string _bucketname, list _offsets} 2011-04-29 11:10:19,918 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(692)) - Adding pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ of tabledefault__temp_temp_index__ 2011-04-29 11:10:19,919 DEBUG optimizer.GenMapRedUtils (GenMapRedUtils.java:setTaskPlan(725)) - Information added for path pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ 2011-04-29 11:10:19,920 INFO optimizer.GenMRFileSink1 (GenMRFileSink1.java:createMergeJob(279)) - use CombineHiveInputformat for the merge job 2011-04-29 11:10:19,921 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:19,922 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:19,925 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:19,925 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:19,926 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:19,926 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:19,929 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:19,930 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:19,930 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6833)) - Completed plan generation 2011-04-29 11:10:19,931 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:19,932 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:`_bucketname`, type:string, comment:null), FieldSchema(name:`_offsets`, type:array, comment:null)], properties:null) 2011-04-29 11:10:19,932 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,933 INFO parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(6833)) - Completed plan generation 2011-04-29 11:10:19,933 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:19,934 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.DelimitedJSONSerDe initialized with: columnNames=[] columnTypes=[] separator=[[B@3bc581d7] nullstring=NULL lastColumnTakesRest=false 2011-04-29 11:10:19,935 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:key, type:string, comment:null), FieldSchema(name:val, type:string, comment:null)], properties:null) 2011-04-29 11:10:19,935 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.DelimitedJSONSerDe initialized with: columnNames=[] columnTypes=[] separator=[[B@5f0ab5d] nullstring=NULL lastColumnTakesRest=false 2011-04-29 11:10:19,936 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:19,936 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:19,936 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0016 2011-04-29 11:10:19,936 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0016 2011-04-29 11:10:19,939 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0016 2011-04-29 11:10:19,953 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0016 type:closeSession cxid:0xd zxid:0xd2 txntype:-11 reqpath:n/a 2011-04-29 11:10:19,953 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0016 type:closeSession cxid:0xd zxid:0xd2 txntype:-11 reqpath:n/a 2011-04-29 11:10:19,954 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0016, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,210,0 request:: null response:: null 2011-04-29 11:10:19,955 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /0:0:0:0:0:0:0:1%0:56327 which had sessionid 0x12fa2738adb0016 2011-04-29 11:10:19,955 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0016 2011-04-29 11:10:19,955 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0016 : Unable to read additional data from server sessionid 0x12fa2738adb0016, likely server has closed socket 2011-04-29 11:10:19,956 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:10:19,956 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0016 closed 2011-04-29 11:10:19,957 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@201bc475 2011-04-29 11:10:19,958 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:10:19,959 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:10:19,959 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56328 2011-04-29 11:10:19,961 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:10:19,961 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56328 client's lastZxid is 0x0 2011-04-29 11:10:19,961 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56328 2011-04-29 11:10:19,962 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:createSession cxid:0x0 zxid:0xd3 txntype:-10 reqpath:n/a 2011-04-29 11:10:19,963 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:createSession cxid:0x0 zxid:0xd3 txntype:-10 reqpath:n/a 2011-04-29 11:10:19,963 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0017 with negotiated timeout 40000 for client /127.0.0.1:56328 2011-04-29 11:10:19,964 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb0017, negotiated timeout = 40000 2011-04-29 11:10:20,138 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:create cxid:0x1 zxid:0xd4 txntype:1 reqpath:n/a 2011-04-29 11:10:20,139 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:create cxid:0x1 zxid:0xd4 txntype:1 reqpath:n/a 2011-04-29 11:10:20,141 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,212,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:10:20,170 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:create cxid:0x2 zxid:0xd5 txntype:1 reqpath:n/a 2011-04-29 11:10:20,177 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:create cxid:0x2 zxid:0xd5 txntype:1 reqpath:n/a 2011-04-29 11:10:20,178 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,213,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f61636164393665302d306662312d343165312d616631322d3662626565366565393036363a313330343130303631393933363a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:10:20,179 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:20,179 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:20,180 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,213,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:20,204 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:create cxid:0x4 zxid:0xd6 txntype:1 reqpath:n/a 2011-04-29 11:10:20,205 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:create cxid:0x4 zxid:0xd6 txntype:1 reqpath:n/a 2011-04-29 11:10:20,206 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,214,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:20,240 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:create cxid:0x5 zxid:0xd7 txntype:1 reqpath:n/a 2011-04-29 11:10:20,241 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:create cxid:0x5 zxid:0xd7 txntype:1 reqpath:n/a 2011-04-29 11:10:20,243 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,215,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f61636164393665302d306662312d343165312d616631322d3662626565366565393036363a313330343130303631393933363a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-SHARED-0000000000 2011-04-29 11:10:20,243 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:20,244 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:20,244 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,215,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:20,258 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:create cxid:0x7 zxid:0xd8 txntype:1 reqpath:n/a 2011-04-29 11:10:20,258 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:create cxid:0x7 zxid:0xd8 txntype:1 reqpath:n/a 2011-04-29 11:10:20,260 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 7,1 replyHeader:: 7,216,0 request:: '/hive_zookeeper_namespace/default/temp,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:20,281 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:create cxid:0x8 zxid:0xd9 txntype:1 reqpath:n/a 2011-04-29 11:10:20,282 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:create cxid:0x8 zxid:0xd9 txntype:1 reqpath:n/a 2011-04-29 11:10:20,283 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 8,1 replyHeader:: 8,217,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f61636164393665302d306662312d343165312d616631322d3662626565366565393036363a313330343130303631393933363a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/temp/LOCK-SHARED-0000000000 2011-04-29 11:10:20,284 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:getChildren cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:20,284 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:getChildren cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:20,285 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 9,8 replyHeader:: 9,217,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:20,285 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:20,285 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:20,286 INFO ql.Driver (Driver.java:execute(972)) - Starting command: SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:20,297 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:20,298 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:20,298 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: QUERY 2011-04-29 11:10:20,299 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Input: default@default__temp_temp_index__ 2011-04-29 11:10:20,299 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Input: default@temp 2011-04-29 11:10:20,299 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-mr-10000 2011-04-29 11:10:20,300 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:20,300 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:20,300 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:20,300 INFO ql.Driver (SessionState.java:printInfo(365)) - Total MapReduce jobs = 3 2011-04-29 11:10:20,301 INFO ql.Driver (SessionState.java:printInfo(365)) - Launching Job 1 out of 3 2011-04-29 11:10:20,304 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Number of reduce tasks is set to 0 since there's no reduce operator 2011-04-29 11:10:20,340 INFO exec.ConditionalTask (MapRedTask.java:execute(161)) - Generating plan file file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-local-10003/plan.xml 2011-04-29 11:10:20,777 INFO exec.ConditionalTask (MapRedTask.java:execute(198)) - Executing: /Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/bin/hadoop jar /Users/rmelick/hive/build/ql/hive-exec-0.8.0-SNAPSHOT.jar org.apache.hadoop.hive.ql.exec.ExecDriver -libjars file:///Users/rmelick/hive/build/ql/test/test-udfs.jar -plan file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-local-10003/plan.xml -nolog -jobconf hive.stats.jdbcdriver=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.aux.jars.path=file%3A%2F%2F%2FUsers%2Frmelick%2Fhive%2Fbuild%2Fql%2Ftest%2Ftest-udfs.jar -jobconf hive.mapjoin.followby.gby.localtask.max.memory.usage=0.55 -jobconf hive.limit.optimize.limit.file=10 -jobconf datanucleus.validateColumns=false -jobconf datanucleus.connectionPoolingType=DBCP -jobconf hadoop.tmp.dir=%24%7Bbuild.dir.hive%7D%2Ftest%2Fhadoop-%24%7Buser.name%7D -jobconf test.src.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Fsrc%2Ftest -jobconf hive.variable.substitute=true -jobconf hive.stats.dbclass=jdbc%3Aderby -jobconf hive.lock.mapred.only.operation=false -jobconf hive.script.serde=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe -jobconf hive.merge.smallfiles.avgsize=16000000 -jobconf datanucleus.cache.level2=false -jobconf hive.hbase.wal.enabled=true -jobconf hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider -jobconf hive.metastore.rawstore.impl=org.apache.hadoop.hive.metastore.ObjectStore -jobconf hive.metastore.local=true -jobconf hive.optimize.ppd.storage=true -jobconf hive.querylog.location=%24%7Bbuild.dir%7D%2Ftmp -jobconf hive.limit.row.max.size=100000 -jobconf hive.rework.mapredwork=false -jobconf hive.added.jars.path= -jobconf hive.metastore.authorization.storage.checks=false -jobconf hive.zookeeper.namespace=hive_zookeeper_namespace -jobconf hive.test.mode.prefix=test_ -jobconf hive.test.mode=false -jobconf hive.exec.compress.intermediate=false -jobconf datanucleus.cache.level2.type=SOFT -jobconf hive.metastore.ds.retry.attempts=1 -jobconf hive.limit.optimize.enable=false -jobconf hive.zookeeper.client.port=21818 -jobconf javax.jdo.option.ConnectionUserName=APP -jobconf hive.merge.mapfiles=true -jobconf hive.test.mode.samplefreq=32 -jobconf hive.optimize.skewjoin=false -jobconf hive.metastore.server.min.threads=200 -jobconf hive.mapjoin.localtask.max.memory.usage=0.90 -jobconf hive.map.aggr.hash.min.reduction=0.5 -jobconf hive.exec.compress.output=false -jobconf hive.script.recordreader=org.apache.hadoop.hive.ql.exec.TextRecordReader -jobconf javax.jdo.option.Multithreaded=true -jobconf hive.exec.post.hooks=org.apache.hadoop.hive.ql.hooks.PostExecutePrinter -jobconf hive.lock.numretries=100 -jobconf hive.exec.parallel.thread.number=8 -jobconf hive.exec.max.created.files=100000 -jobconf hive.exec.default.partition.name=__HIVE_DEFAULT_PARTITION__ -jobconf test.log.dir=%24%7Bbuild.dir%7D%2Ftest%2Flogs -jobconf hive.archive.har.parentdir.settable=false -jobconf hive.exec.pre.hooks=org.apache.hadoop.hive.ql.hooks.PreExecutePrinter%2C+org.apache.hadoop.hive.ql.hooks.EnforceReadOnlyTables -jobconf hive.exec.mode.local.auto=false -jobconf hive.optimize.index.filter=true -jobconf datanucleus.storeManagerType=rdbms -jobconf hive.script.operator.id.env.var=HIVE_SCRIPT_OPERATOR_ID -jobconf hive.metastore.ds.retry.interval=1000 -jobconf hive.skewjoin.mapjoin.min.split=33554432 -jobconf hive.metastore.client.connect.retry.delay=1 -jobconf hive.auto.convert.join=false -jobconf hive.metastore.warehouse.dir=%24%7Btest.warehouse.dir%7D -jobconf hive.mapjoin.bucket.cache.size=100 -jobconf datanucleus.transactionIsolation=read-committed -jobconf hive.stats.jdbc.timeout=30 -jobconf hive.concurrency.manager=org.apache.hadoop.hive.ql.lockmgr.ZooKeeperLockMgr -jobconf hive.mergejob.maponly=true -jobconf hive.fetch.output.serde=org.apache.hadoop.hive.serde2.DelimitedJSONSerDe -jobconf hive.mapjoin.followby.map.aggr.hash.percentmemory=0.3 -jobconf hive.exim.uri.scheme.whitelist=hdfs%2Cpfile -jobconf hive.stats.dbconnectionstring=jdbc%3Aderby%3A%3BdatabaseName%3DTempStatsStore%3Bcreate%3Dtrue -jobconf mapred.reduce.tasks=-1 -jobconf hive.optimize.index.filter.compact.minsize=0 -jobconf hive.skewjoin.key=100000 -jobconf javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.DummyAuthenticator -jobconf hive.udtf.auto.progress=false -jobconf hive.session.id=rmelick_201104291109 -jobconf mapred.job.name=SELECT+*+FROM+temp+WHERE+key+%3E+45+AND+k...55%28Stage-3%29 -jobconf hive.exec.script.maxerrsize=100000 -jobconf hive.optimize.groupby=true -jobconf datanucleus.plugin.pluginRegistryBundleCheck=LOG -jobconf hive.exec.rowoffset=false -jobconf hive.default.fileformat=TextFile -jobconf hive.mapjoin.smalltable.filesize=25000000 -jobconf hive.exec.scratchdir=%24%7Bbuild.dir%7D%2Fscratchdir -jobconf datanucleus.identifierFactory=datanucleus -jobconf hive.exec.max.dynamic.partitions.pernode=100 -jobconf hive.join.emit.interval=1000 -jobconf hive.script.recordwriter=org.apache.hadoop.hive.ql.exec.TextRecordWriter -jobconf datanucleus.validateConstraints=false -jobconf hive.exec.dynamic.partition=false -jobconf hive.optimize.index.filter.compact.maxsize=-1 -jobconf hive.metastore.client.socket.timeout=20 -jobconf hive.map.aggr.hash.force.flush.memory.threshold=0.9 -jobconf hive.exec.show.job.failure.debug.info=false -jobconf hive.join.cache.size=25000 -jobconf datanucleus.autoStartMechanismMode=checked -jobconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat -jobconf hive.skewjoin.mapjoin.map.tasks=10000 -jobconf hive.exec.drop.ignorenonexistent=true -jobconf hive.hwi.listen.port=9999 -jobconf hive.session.silent=true -jobconf hive.cli.print.header=false -jobconf hive.groupby.mapaggr.checkinterval=100000 -jobconf hive.metastore.server.max.threads=100000 -jobconf hive.metastore.kerberos.principal=hive-metastore%2F_HOST%40EXAMPLE.COM -jobconf javax.jdo.option.ConnectionURL=jdbc%3Aderby%3A%3BdatabaseName%3D..%2Fbuild%2Ftest%2Fjunit_metastore_db%3Bcreate%3Dtrue -jobconf hive.mapred.mode=nonstrict -jobconf hive.metastore.batch.retrieve.max=300 -jobconf hive.groupby.skewindata=false -jobconf hive.exec.parallel=false -jobconf hive.zookeeper.clean.extra.nodes=false -jobconf test.data.files=%24%7Buser.dir%7D%2F..%2Fdata%2Ffiles -jobconf hive.merge.size.per.task=256000000 -jobconf fs.har.impl=org.apache.hadoop.hive.shims.HiveHarFileSystem -jobconf hive.exec.reducers.max=999 -jobconf fs.pfile.impl=org.apache.hadoop.fs.ProxyLocalFileSystem -jobconf hive.query.string=%0ASELECT+*+FROM+temp+WHERE+key+%3E+45+AND+key+%3C+55 -jobconf hive.optimize.ppd=true -jobconf hive.metastore.cache.pinobjtypes=Table%2CStorageDescriptor%2CSerDeInfo%2CPartition%2CDatabase%2CType%2CFieldSchema%2COrder -jobconf hive.mapjoin.hashtable.initialCapacity=100000 -jobconf hive.jar.path=%24%7Bbuild.dir.hive%7D%2Fql%2Fhive-exec-%24%7Bversion%7D.jar -jobconf hive.mapjoin.cache.numrows=25000 -jobconf hive.merge.mapredfiles=false -jobconf hive.metastore.sasl.enabled=false -jobconf hive.fileformat.check=true -jobconf hive.metastore.connect.retries=5 -jobconf hive.query.id=rmelick_20110429111010_acad96e0-0fb1-41e1-af12-6bbee6ee9066 -jobconf hive.zookeeper.quorum=localhost -jobconf javax.jdo.option.DetachAllOnCommit=true -jobconf hive.metastore.metadb.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Ftest%2Fdata%2Fmetadb%2F -jobconf javax.jdo.option.ConnectionPassword=mine -jobconf hive.optimize.pruner=true -jobconf hive.optimize.reducededuplication=true -jobconf hive.hwi.listen.host=0.0.0.0 -jobconf hive.index.compact.file.ignore.hdfs=false -jobconf hive.auto.progress.timeout=0 -jobconf hive.map.aggr.hash.percentmemory=0.5 -jobconf hive.mapjoin.check.memory.rows=100000 -jobconf javax.jdo.PersistenceManagerFactoryClass=org.datanucleus.jdo.JDOPersistenceManagerFactory -jobconf hive.mapred.local.mem=0 -jobconf datanucleus.validateTables=false -jobconf hive.exec.max.dynamic.partitions=1000 -jobconf hive.stats.jdbc.atomic=false -jobconf hive.exec.dynamic.partition.mode=strict -jobconf hive.hwi.war.file=lib%2Fhive-hwi-%40VERSION%40.war -jobconf hive.script.auto.progress=false -jobconf hive.lock.sleep.between.retries=60 -jobconf hive.enforce.sorting=false -jobconf datanucleus.autoCreateSchema=true -jobconf hive.task.progress=false -jobconf hive.metastore.server.tcp.keepalive=true -jobconf hive.stats.autogather=true -jobconf hive.map.aggr=true -jobconf hive.enforce.bucketing=false -jobconf hive.limit.optimize.fetch.max=50000 -jobconf hive.exec.script.allow.partial.consumption=false -jobconf hive.archive.enabled=false -jobconf hive.support.concurrency=true -jobconf hive.mapjoin.hashtable.loadfactor=0.75 -jobconf hive.mapred.reduce.tasks.speculative.execution=true -jobconf hive.heartbeat.interval=1000 -jobconf hive.exec.counters.pull.interval=1000 -jobconf hive.mapjoin.maxsize=100000 -jobconf javax.jdo.option.NonTransactionalRead=true -jobconf hive.optimize.cp=true -jobconf hive.exec.reducers.bytes.per.reducer=1000000000 -jobconf test.query.file1=file%3A%2F%2F%24%7Buser.dir%7D%2F..%2Fql%2Fsrc%2Ftest%2Forg%2Fapache%2Fhadoop%2Fhive%2Fql%2Finput2.q -jobconf hive.error.on.empty.partition=false -jobconf hive.security.authorization.enabled=false -jobconf mapred.system.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Fsystem%2F-823662847 -jobconf mapred.local.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Flocal%2F-437594480 2011-04-29 11:10:29,695 INFO exec.ConditionalTask (MapRedTask.java:execute(266)) - Execution completed successfully 2011-04-29 11:10:29,700 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Ended Job = -535944525, job is filtered out (removed at runtime). 2011-04-29 11:10:29,703 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Moving data to: file:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-10-19_862_1075291601252520970/-ext-10000 from file:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-10-19_862_1075291601252520970/-ext-10001 2011-04-29 11:10:29,707 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Moving data to: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-mr-10002 from file:/Users/rmelick/hive/build/ql/scratchdir/hive_2011-04-29_11-10-19_862_1075291601252520970/-ext-10000 2011-04-29 11:10:29,753 INFO ql.Driver (SessionState.java:printInfo(365)) - Launching Job 3 out of 3 2011-04-29 11:10:29,756 INFO exec.ConditionalTask (SessionState.java:printInfo(365)) - Number of reduce tasks is set to 0 since there's no reduce operator 2011-04-29 11:10:29,792 INFO exec.ConditionalTask (MapRedTask.java:execute(161)) - Generating plan file file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-local-10004/plan.xml 2011-04-29 11:10:30,005 INFO exec.ConditionalTask (MapRedTask.java:execute(198)) - Executing: /Users/rmelick/hive/build/hadoopcore/hadoop-0.20.1/bin/hadoop jar /Users/rmelick/hive/build/ql/hive-exec-0.8.0-SNAPSHOT.jar org.apache.hadoop.hive.ql.exec.ExecDriver -libjars file:///Users/rmelick/hive/build/ql/test/test-udfs.jar -plan file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-local-10004/plan.xml -nolog -jobconf hive.stats.jdbcdriver=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.aux.jars.path=file%3A%2F%2F%2FUsers%2Frmelick%2Fhive%2Fbuild%2Fql%2Ftest%2Ftest-udfs.jar -jobconf hive.mapjoin.followby.gby.localtask.max.memory.usage=0.55 -jobconf hive.limit.optimize.limit.file=10 -jobconf datanucleus.validateColumns=false -jobconf datanucleus.connectionPoolingType=DBCP -jobconf hadoop.tmp.dir=%24%7Bbuild.dir.hive%7D%2Ftest%2Fhadoop-%24%7Buser.name%7D -jobconf test.src.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Fsrc%2Ftest -jobconf hive.variable.substitute=true -jobconf hive.stats.dbclass=jdbc%3Aderby -jobconf hive.lock.mapred.only.operation=false -jobconf hive.script.serde=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe -jobconf hive.merge.smallfiles.avgsize=16000000 -jobconf datanucleus.cache.level2=false -jobconf hive.hbase.wal.enabled=true -jobconf hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider -jobconf hive.metastore.rawstore.impl=org.apache.hadoop.hive.metastore.ObjectStore -jobconf hive.metastore.local=true -jobconf hive.optimize.ppd.storage=true -jobconf hive.querylog.location=%24%7Bbuild.dir%7D%2Ftmp -jobconf hive.limit.row.max.size=100000 -jobconf hive.rework.mapredwork=false -jobconf hive.added.jars.path= -jobconf hive.metastore.authorization.storage.checks=false -jobconf hive.zookeeper.namespace=hive_zookeeper_namespace -jobconf hive.test.mode.prefix=test_ -jobconf hive.test.mode=false -jobconf hive.exec.compress.intermediate=false -jobconf datanucleus.cache.level2.type=SOFT -jobconf hive.metastore.ds.retry.attempts=1 -jobconf hive.limit.optimize.enable=false -jobconf hive.zookeeper.client.port=21818 -jobconf javax.jdo.option.ConnectionUserName=APP -jobconf hive.merge.mapfiles=true -jobconf hive.test.mode.samplefreq=32 -jobconf hive.optimize.skewjoin=false -jobconf hive.metastore.server.min.threads=200 -jobconf hive.mapjoin.localtask.max.memory.usage=0.90 -jobconf hive.map.aggr.hash.min.reduction=0.5 -jobconf hive.exec.compress.output=false -jobconf hive.script.recordreader=org.apache.hadoop.hive.ql.exec.TextRecordReader -jobconf javax.jdo.option.Multithreaded=true -jobconf hive.exec.post.hooks=org.apache.hadoop.hive.ql.hooks.PostExecutePrinter -jobconf hive.lock.numretries=100 -jobconf hive.exec.parallel.thread.number=8 -jobconf hive.exec.max.created.files=100000 -jobconf hive.exec.default.partition.name=__HIVE_DEFAULT_PARTITION__ -jobconf test.log.dir=%24%7Bbuild.dir%7D%2Ftest%2Flogs -jobconf hive.archive.har.parentdir.settable=false -jobconf hive.exec.pre.hooks=org.apache.hadoop.hive.ql.hooks.PreExecutePrinter%2C+org.apache.hadoop.hive.ql.hooks.EnforceReadOnlyTables -jobconf hive.exec.mode.local.auto=false -jobconf hive.optimize.index.filter=true -jobconf datanucleus.storeManagerType=rdbms -jobconf hive.script.operator.id.env.var=HIVE_SCRIPT_OPERATOR_ID -jobconf hive.metastore.ds.retry.interval=1000 -jobconf hive.skewjoin.mapjoin.min.split=33554432 -jobconf hive.metastore.client.connect.retry.delay=1 -jobconf hive.auto.convert.join=false -jobconf hive.metastore.warehouse.dir=%24%7Btest.warehouse.dir%7D -jobconf hive.mapjoin.bucket.cache.size=100 -jobconf datanucleus.transactionIsolation=read-committed -jobconf hive.stats.jdbc.timeout=30 -jobconf hive.concurrency.manager=org.apache.hadoop.hive.ql.lockmgr.ZooKeeperLockMgr -jobconf hive.mergejob.maponly=true -jobconf hive.fetch.output.serde=org.apache.hadoop.hive.serde2.DelimitedJSONSerDe -jobconf hive.mapjoin.followby.map.aggr.hash.percentmemory=0.3 -jobconf hive.exim.uri.scheme.whitelist=hdfs%2Cpfile -jobconf hive.stats.dbconnectionstring=jdbc%3Aderby%3A%3BdatabaseName%3DTempStatsStore%3Bcreate%3Dtrue -jobconf mapred.reduce.tasks=-1 -jobconf hive.optimize.index.filter.compact.minsize=0 -jobconf hive.skewjoin.key=100000 -jobconf javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.EmbeddedDriver -jobconf hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.DummyAuthenticator -jobconf hive.udtf.auto.progress=false -jobconf hive.session.id=rmelick_201104291109 -jobconf mapred.job.name=SELECT+*+FROM+temp+WHERE+key+%3E+45+AND+k...55%28Stage-1%29 -jobconf hive.exec.script.maxerrsize=100000 -jobconf hive.optimize.groupby=true -jobconf datanucleus.plugin.pluginRegistryBundleCheck=LOG -jobconf hive.exec.rowoffset=false -jobconf hive.default.fileformat=TextFile -jobconf hive.mapjoin.smalltable.filesize=25000000 -jobconf hive.exec.scratchdir=%24%7Bbuild.dir%7D%2Fscratchdir -jobconf datanucleus.identifierFactory=datanucleus -jobconf hive.exec.max.dynamic.partitions.pernode=100 -jobconf hive.join.emit.interval=1000 -jobconf hive.script.recordwriter=org.apache.hadoop.hive.ql.exec.TextRecordWriter -jobconf datanucleus.validateConstraints=false -jobconf hive.exec.dynamic.partition=false -jobconf hive.optimize.index.filter.compact.maxsize=-1 -jobconf hive.metastore.client.socket.timeout=20 -jobconf hive.map.aggr.hash.force.flush.memory.threshold=0.9 -jobconf hive.exec.show.job.failure.debug.info=false -jobconf hive.join.cache.size=25000 -jobconf datanucleus.autoStartMechanismMode=checked -jobconf hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat -jobconf hive.skewjoin.mapjoin.map.tasks=10000 -jobconf hive.exec.drop.ignorenonexistent=true -jobconf hive.hwi.listen.port=9999 -jobconf hive.session.silent=true -jobconf hive.cli.print.header=false -jobconf hive.groupby.mapaggr.checkinterval=100000 -jobconf hive.metastore.server.max.threads=100000 -jobconf hive.metastore.kerberos.principal=hive-metastore%2F_HOST%40EXAMPLE.COM -jobconf javax.jdo.option.ConnectionURL=jdbc%3Aderby%3A%3BdatabaseName%3D..%2Fbuild%2Ftest%2Fjunit_metastore_db%3Bcreate%3Dtrue -jobconf hive.mapred.mode=nonstrict -jobconf hive.metastore.batch.retrieve.max=300 -jobconf hive.groupby.skewindata=false -jobconf hive.exec.parallel=false -jobconf hive.zookeeper.clean.extra.nodes=false -jobconf test.data.files=%24%7Buser.dir%7D%2F..%2Fdata%2Ffiles -jobconf hive.merge.size.per.task=256000000 -jobconf fs.har.impl=org.apache.hadoop.hive.shims.HiveHarFileSystem -jobconf hive.exec.reducers.max=999 -jobconf fs.pfile.impl=org.apache.hadoop.fs.ProxyLocalFileSystem -jobconf hive.query.string=%0ASELECT+*+FROM+temp+WHERE+key+%3E+45+AND+key+%3C+55 -jobconf hive.optimize.ppd=true -jobconf hive.metastore.cache.pinobjtypes=Table%2CStorageDescriptor%2CSerDeInfo%2CPartition%2CDatabase%2CType%2CFieldSchema%2COrder -jobconf hive.mapjoin.hashtable.initialCapacity=100000 -jobconf hive.jar.path=%24%7Bbuild.dir.hive%7D%2Fql%2Fhive-exec-%24%7Bversion%7D.jar -jobconf hive.mapjoin.cache.numrows=25000 -jobconf hive.merge.mapredfiles=false -jobconf hive.metastore.sasl.enabled=false -jobconf hive.fileformat.check=true -jobconf hive.metastore.connect.retries=5 -jobconf hive.query.id=rmelick_20110429111010_acad96e0-0fb1-41e1-af12-6bbee6ee9066 -jobconf hive.zookeeper.quorum=localhost -jobconf javax.jdo.option.DetachAllOnCommit=true -jobconf hive.metastore.metadb.dir=file%3A%2F%2F%24%7Bbuild.dir%7D%2Ftest%2Fdata%2Fmetadb%2F -jobconf javax.jdo.option.ConnectionPassword=mine -jobconf hive.optimize.pruner=true -jobconf hive.optimize.reducededuplication=true -jobconf hive.hwi.listen.host=0.0.0.0 -jobconf hive.index.compact.file.ignore.hdfs=false -jobconf hive.auto.progress.timeout=0 -jobconf hive.map.aggr.hash.percentmemory=0.5 -jobconf hive.mapjoin.check.memory.rows=100000 -jobconf javax.jdo.PersistenceManagerFactoryClass=org.datanucleus.jdo.JDOPersistenceManagerFactory -jobconf hive.mapred.local.mem=0 -jobconf datanucleus.validateTables=false -jobconf hive.exec.max.dynamic.partitions=1000 -jobconf hive.stats.jdbc.atomic=false -jobconf hive.exec.dynamic.partition.mode=strict -jobconf hive.hwi.war.file=lib%2Fhive-hwi-%40VERSION%40.war -jobconf hive.script.auto.progress=false -jobconf hive.lock.sleep.between.retries=60 -jobconf hive.enforce.sorting=false -jobconf datanucleus.autoCreateSchema=true -jobconf hive.task.progress=false -jobconf hive.metastore.server.tcp.keepalive=true -jobconf hive.stats.autogather=true -jobconf hive.map.aggr=true -jobconf hive.enforce.bucketing=false -jobconf hive.limit.optimize.fetch.max=50000 -jobconf hive.exec.script.allow.partial.consumption=false -jobconf hive.archive.enabled=false -jobconf hive.support.concurrency=true -jobconf hive.mapjoin.hashtable.loadfactor=0.75 -jobconf hive.mapred.reduce.tasks.speculative.execution=true -jobconf hive.heartbeat.interval=1000 -jobconf hive.exec.counters.pull.interval=1000 -jobconf hive.mapjoin.maxsize=100000 -jobconf javax.jdo.option.NonTransactionalRead=true -jobconf hive.optimize.cp=true -jobconf hive.exec.reducers.bytes.per.reducer=1000000000 -jobconf test.query.file1=file%3A%2F%2F%24%7Buser.dir%7D%2F..%2Fql%2Fsrc%2Ftest%2Forg%2Fapache%2Fhadoop%2Fhive%2Fql%2Finput2.q -jobconf hive.error.on.empty.partition=false -jobconf hive.security.authorization.enabled=false -jobconf mapred.system.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Fsystem%2F2042393292 -jobconf mapred.local.dir=%2FUsers%2Frmelick%2Fhive%2Fbuild%2Ftest%2Fhadoop-rmelick%2Fmapred%2Flocal%2F308447360 2011-04-29 11:10:32,121 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0010 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:32,122 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0010 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:32,123 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(721)) - Got ping response for sessionid: 0x12fa2738adb0010 after 2ms 2011-04-29 11:10:32,495 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0011 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:32,495 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0011 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:32,495 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(721)) - Got ping response for sessionid: 0x12fa2738adb0011 after 1ms 2011-04-29 11:10:33,618 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:33,618 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2011-04-29 11:10:33,618 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(721)) - Got ping response for sessionid: 0x12fa2738adb0017 after 1ms 2011-04-29 11:10:34,769 INFO exec.ConditionalTask (MapRedTask.java:execute(266)) - Execution completed successfully 2011-04-29 11:10:34,771 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:34,771 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: SELECT * FROM temp WHERE key > 45 AND key < 55 2011-04-29 11:10:34,772 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: QUERY 2011-04-29 11:10:34,772 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Input: default@default__temp_temp_index__ 2011-04-29 11:10:34,772 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Input: default@temp 2011-04-29 11:10:34,772 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: file:/var/folders/D-/D-v4r3JYHU4wWmtdk5+mbU+++TI/-Tmp-/rmelick/hive_2011-04-29_11-10-19_694_3991696337436359389/-mr-10000 2011-04-29 11:10:34,773 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._bucketname SIMPLE [(temp)temp.FieldSchema(name:INPUT__FILE__NAME, type:string, comment:), ] 2011-04-29 11:10:34,773 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._offsets EXPRESSION [(temp)temp.FieldSchema(name:BLOCK__OFFSET__INSIDE__FILE, type:bigint, comment:), ] 2011-04-29 11:10:34,773 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__.key SIMPLE [(temp)temp.FieldSchema(name:key, type:string, comment:null), ] 2011-04-29 11:10:34,773 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:34,774 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:34,774 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:34,774 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:34,774 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:34,775 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:34,776 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:10:34,776 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:34,778 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:delete cxid:0xa zxid:0xda txntype:2 reqpath:n/a 2011-04-29 11:10:34,778 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:delete cxid:0xa zxid:0xda txntype:2 reqpath:n/a 2011-04-29 11:10:34,779 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,218,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:34,780 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:34,780 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:34,780 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,218,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{} 2011-04-29 11:10:34,781 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:delete cxid:0xc zxid:0xdb txntype:2 reqpath:n/a 2011-04-29 11:10:34,782 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:delete cxid:0xc zxid:0xdb txntype:2 reqpath:n/a 2011-04-29 11:10:34,782 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,219,0 request:: '/hive_zookeeper_namespace/default/temp,-1 response:: null 2011-04-29 11:10:34,783 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:delete cxid:0xd zxid:0xdc txntype:2 reqpath:n/a 2011-04-29 11:10:34,783 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:delete cxid:0xd zxid:0xdc txntype:2 reqpath:n/a 2011-04-29 11:10:34,784 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 13,2 replyHeader:: 13,220,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:34,784 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:getChildren cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:34,785 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:getChildren cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/default__temp_temp_index__ 2011-04-29 11:10:34,785 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 14,8 replyHeader:: 14,220,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,F response:: v{} 2011-04-29 11:10:34,786 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:delete cxid:0xf zxid:0xdd txntype:2 reqpath:n/a 2011-04-29 11:10:34,787 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:delete cxid:0xf zxid:0xdd txntype:2 reqpath:n/a 2011-04-29 11:10:34,787 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 15,2 replyHeader:: 15,221,0 request:: '/hive_zookeeper_namespace/default/default__temp_temp_index__,-1 response:: null 2011-04-29 11:10:34,788 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:delete cxid:0x10 zxid:0xde txntype:2 reqpath:n/a 2011-04-29 11:10:34,788 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:delete cxid:0x10 zxid:0xde txntype:2 reqpath:n/a 2011-04-29 11:10:34,789 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 16,2 replyHeader:: 16,222,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:34,789 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:getChildren cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:34,790 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:getChildren cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:34,790 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 17,8 replyHeader:: 17,222,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:10:34,791 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:delete cxid:0x12 zxid:0xdf txntype:2 reqpath:n/a 2011-04-29 11:10:34,792 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:delete cxid:0x12 zxid:0xdf txntype:2 reqpath:n/a 2011-04-29 11:10:34,792 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 18,2 replyHeader:: 18,223,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:10:34,792 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:34,831 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1 2011-04-29 11:10:34,831 DEBUG mapred.FileInputFormat (FileInputFormat.java:getSplits(248)) - Total # of splits: 1 2011-04-29 11:10:34,832 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0, _col1] columnTypes=[string, string] separator=[[B@35b4e829] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:34,833 DEBUG exec.FetchOperator (FetchOperator.java:getRecordReader(287)) - Creating fetchTask with deserializer typeinfo: struct<_col0:string,_col1:string> 2011-04-29 11:10:34,833 DEBUG exec.FetchOperator (FetchOperator.java:getRecordReader(289)) - deserializer properties: {columns=_col0,_col1, serialization.format=1, columns.types=string:string} 2011-04-29 11:10:34,837 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 15.144 seconds 2011-04-29 11:10:34,837 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: org.apache.hadoop.hive.ql.io.HiveInputFormat 2011-04-29 11:10:34,838 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: false 2011-04-29 11:10:34,838 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:34,838 DEBUG parse.VariableSubstitution (VariableSubstitution.java:substitute(38)) - Substitution is on: DROP table temp 2011-04-29 11:10:34,839 INFO parse.ParseDriver (ParseDriver.java:parse(393)) - Parsing command: DROP table temp 2011-04-29 11:10:34,868 INFO parse.ParseDriver (ParseDriver.java:parse(410)) - Parse Completed 2011-04-29 11:10:34,869 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:34,890 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:34,891 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@4a65d816] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:34,919 INFO ql.Driver (Driver.java:compile(370)) - Semantic Analysis Completed 2011-04-29 11:10:34,921 INFO ql.Driver (Driver.java:getSchema(242)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2011-04-29 11:10:34,921 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:34,921 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:34,922 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0017 2011-04-29 11:10:34,922 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0017 2011-04-29 11:10:34,923 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0017 2011-04-29 11:10:34,924 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0017 type:closeSession cxid:0x13 zxid:0xe0 txntype:-11 reqpath:n/a 2011-04-29 11:10:34,924 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0017 type:closeSession cxid:0x13 zxid:0xe0 txntype:-11 reqpath:n/a 2011-04-29 11:10:34,925 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0017, packet:: clientPath:null serverPath:null finished:false header:: 19,-11 replyHeader:: 19,224,0 request:: null response:: null 2011-04-29 11:10:34,926 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0017 2011-04-29 11:10:34,926 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0017 closed 2011-04-29 11:10:34,926 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56328 which had sessionid 0x12fa2738adb0017 2011-04-29 11:10:34,928 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@6083dc9b 2011-04-29 11:10:34,929 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1458)) - ignoring exception during input shutdown java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.server.NIOServerCnxn.closeSock(NIOServerCnxn.java:1454) at org.apache.zookeeper.server.NIOServerCnxn.close(NIOServerCnxn.java:1411) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:631) at org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:261) 2011-04-29 11:10:34,930 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:10:34,932 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/0:0:0:0:0:0:0:1:21818, initiating session 2011-04-29 11:10:34,932 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /0:0:0:0:0:0:0:1%0:56329 2011-04-29 11:10:34,932 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:10:34,935 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /0:0:0:0:0:0:0:1%0:56329 client's lastZxid is 0x0 2011-04-29 11:10:34,935 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /0:0:0:0:0:0:0:1%0:56329 2011-04-29 11:10:34,936 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:createSession cxid:0x0 zxid:0xe1 txntype:-10 reqpath:n/a 2011-04-29 11:10:34,936 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:createSession cxid:0x0 zxid:0xe1 txntype:-10 reqpath:n/a 2011-04-29 11:10:34,937 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0018 with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1%0:56329 2011-04-29 11:10:34,937 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21818, sessionid = 0x12fa2738adb0018, negotiated timeout = 40000 2011-04-29 11:10:34,938 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:create cxid:0x1 zxid:0xe2 txntype:1 reqpath:n/a 2011-04-29 11:10:34,938 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:create cxid:0x1 zxid:0xe2 txntype:1 reqpath:n/a 2011-04-29 11:10:34,939 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,226,0 request:: '/hive_zookeeper_namespace/default,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default 2011-04-29 11:10:34,941 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:create cxid:0x2 zxid:0xe3 txntype:1 reqpath:n/a 2011-04-29 11:10:34,941 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:create cxid:0x2 zxid:0xe3 txntype:1 reqpath:n/a 2011-04-29 11:10:34,942 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 2,1 replyHeader:: 2,227,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-,#726d656c69636b5f32303131303432393131313031305f63643236613537342d333665632d346161332d383265372d6636303739383965303932333a313330343130303633343932323a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000 2011-04-29 11:10:34,942 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:34,942 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:getChildren cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:34,943 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,227,0 request:: '/hive_zookeeper_namespace/default,F response:: v{'LOCK-SHARED-0000000000} 2011-04-29 11:10:34,944 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:create cxid:0x4 zxid:0xe4 txntype:1 reqpath:n/a 2011-04-29 11:10:34,944 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:create cxid:0x4 zxid:0xe4 txntype:1 reqpath:n/a 2011-04-29 11:10:34,945 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,228,0 request:: '/hive_zookeeper_namespace/default/temp,,v{s{31,s{'world,'anyone}}},0 response:: '/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:34,946 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:create cxid:0x5 zxid:0xe5 txntype:1 reqpath:n/a 2011-04-29 11:10:34,947 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:create cxid:0x5 zxid:0xe5 txntype:1 reqpath:n/a 2011-04-29 11:10:34,947 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,229,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-,#726d656c69636b5f32303131303432393131313031305f63643236613537342d333665632d346161332d383265372d6636303739383965303932333a313330343130303633343932323a494d504c49434954,v{s{31,s{'world,'anyone}}},3 response:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-0000000000 2011-04-29 11:10:34,948 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:34,948 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:getChildren cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:34,949 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 6,8 replyHeader:: 6,229,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{'LOCK-EXCLUSIVE-0000000000} 2011-04-29 11:10:34,949 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:34,949 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:34,949 INFO ql.Driver (Driver.java:execute(972)) - Starting command: DROP table temp 2011-04-29 11:10:34,950 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:34,950 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: query: DROP table temp 2011-04-29 11:10:34,950 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: type: DROPTABLE 2011-04-29 11:10:34,951 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Input: default@temp 2011-04-29 11:10:34,951 ERROR SessionState (SessionState.java:printError(374)) - PREHOOK: Output: default@temp 2011-04-29 11:10:34,951 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:34,951 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:34,952 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:34,952 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:34,966 INFO hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(454)) - DDL: struct temp { string key, string val} 2011-04-29 11:10:34,967 DEBUG lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(190)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[key, val] columnTypes=[string, string] separator=[[B@53543f09] nullstring=\N lastColumnTakesRest=false 2011-04-29 11:10:34,967 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:34,983 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=temp 2011-04-29 11:10:34,984 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=temp 2011-04-29 11:10:34,992 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:34,995 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:34,998 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:35,002 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_index_by_name: db=default tbl=temp index=temp_index 2011-04-29 11:10:35,002 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_index_by_name: db=default tbl=temp index=temp_index 2011-04-29 11:10:35,106 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=default__temp_temp_index__ 2011-04-29 11:10:35,116 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:35,299 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:35,299 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:35,300 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:35,447 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:35,448 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:35,448 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:35,597 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:35,598 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:35,598 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:35,744 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:35,745 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:35,745 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:35,769 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:35,770 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:35,853 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ 2011-04-29 11:10:35,854 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/default__temp_temp_index__ 2011-04-29 11:10:35,854 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:35,879 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:35,879 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:35,890 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:35,912 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:35,920 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:35,920 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:35,922 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:35,922 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:35,922 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:35,949 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:35,949 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:35,949 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:35,951 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:35,952 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:35,952 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:35,954 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:35,954 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:35,966 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp 2011-04-29 11:10:35,967 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/temp 2011-04-29 11:10:35,968 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:35,968 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: query: DROP table temp 2011-04-29 11:10:35,968 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: type: DROPTABLE 2011-04-29 11:10:35,969 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Input: default@temp 2011-04-29 11:10:35,969 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Output: default@temp 2011-04-29 11:10:35,969 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._bucketname SIMPLE [(temp)temp.FieldSchema(name:INPUT__FILE__NAME, type:string, comment:), ] 2011-04-29 11:10:35,969 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__._offsets EXPRESSION [(temp)temp.FieldSchema(name:BLOCK__OFFSET__INSIDE__FILE, type:bigint, comment:), ] 2011-04-29 11:10:35,969 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: default__temp_temp_index__.key SIMPLE [(temp)temp.FieldSchema(name:key, type:string, comment:null), ] 2011-04-29 11:10:35,970 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:35,970 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ] 2011-04-29 11:10:35,970 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:35,970 ERROR SessionState (SessionState.java:printError(374)) - POSTHOOK: Lineage: temp.val SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 2011-04-29 11:10:35,970 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:35,971 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:35,971 INFO ql.Driver (SessionState.java:printInfo(365)) - OK 2011-04-29 11:10:35,972 INFO ql.Driver (Utilities.java:PerfLogBegin(1980)) - 2011-04-29 11:10:35,973 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:delete cxid:0x7 zxid:0xe6 txntype:2 reqpath:n/a 2011-04-29 11:10:35,974 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:delete cxid:0x7 zxid:0xe6 txntype:2 reqpath:n/a 2011-04-29 11:10:35,974 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 7,2 replyHeader:: 7,230,0 request:: '/hive_zookeeper_namespace/default/temp/LOCK-EXCLUSIVE-0000000000,-1 response:: null 2011-04-29 11:10:35,975 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:35,975 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:getChildren cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default/temp 2011-04-29 11:10:35,975 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 8,8 replyHeader:: 8,230,0 request:: '/hive_zookeeper_namespace/default/temp,F response:: v{} 2011-04-29 11:10:35,976 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:delete cxid:0x9 zxid:0xe7 txntype:2 reqpath:n/a 2011-04-29 11:10:35,977 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:delete cxid:0x9 zxid:0xe7 txntype:2 reqpath:n/a 2011-04-29 11:10:35,977 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 9,2 replyHeader:: 9,231,0 request:: '/hive_zookeeper_namespace/default/temp,-1 response:: null 2011-04-29 11:10:35,979 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:delete cxid:0xa zxid:0xe8 txntype:2 reqpath:n/a 2011-04-29 11:10:35,979 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:delete cxid:0xa zxid:0xe8 txntype:2 reqpath:n/a 2011-04-29 11:10:35,979 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 10,2 replyHeader:: 10,232,0 request:: '/hive_zookeeper_namespace/default/LOCK-SHARED-0000000000,-1 response:: null 2011-04-29 11:10:35,980 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:35,980 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:getChildren cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace/default 2011-04-29 11:10:35,981 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 11,8 replyHeader:: 11,232,0 request:: '/hive_zookeeper_namespace/default,F response:: v{} 2011-04-29 11:10:35,982 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:delete cxid:0xc zxid:0xe9 txntype:2 reqpath:n/a 2011-04-29 11:10:35,982 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:delete cxid:0xc zxid:0xe9 txntype:2 reqpath:n/a 2011-04-29 11:10:35,982 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 12,2 replyHeader:: 12,233,0 request:: '/hive_zookeeper_namespace/default,-1 response:: null 2011-04-29 11:10:35,982 INFO ql.Driver (Utilities.java:PerfLogEnd(2004)) - 2011-04-29 11:10:35,983 INFO CliDriver (SessionState.java:printInfo(365)) - Time taken: 1.145 seconds 2011-04-29 11:10:35,983 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0018 2011-04-29 11:10:35,983 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0018 2011-04-29 11:10:35,984 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0018 2011-04-29 11:10:35,985 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0018 type:closeSession cxid:0xd zxid:0xea txntype:-11 reqpath:n/a 2011-04-29 11:10:35,985 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0018 type:closeSession cxid:0xd zxid:0xea txntype:-11 reqpath:n/a 2011-04-29 11:10:35,985 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /0:0:0:0:0:0:0:1%0:56329 which had sessionid 0x12fa2738adb0018 2011-04-29 11:10:35,986 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0018, packet:: clientPath:null serverPath:null finished:false header:: 13,-11 replyHeader:: 13,234,0 request:: null response:: null 2011-04-29 11:10:35,986 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0018 : Unable to read additional data from server sessionid 0x12fa2738adb0018, likely server has closed socket 2011-04-29 11:10:35,986 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:10:35,986 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0018 2011-04-29 11:10:35,987 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0018 closed 2011-04-29 11:10:36,174 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0011 2011-04-29 11:10:36,175 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0011 2011-04-29 11:10:36,179 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0011 2011-04-29 11:10:36,180 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0011 type:closeSession cxid:0x1 zxid:0xeb txntype:-11 reqpath:n/a 2011-04-29 11:10:36,181 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0011 type:closeSession cxid:0x1 zxid:0xeb txntype:-11 reqpath:n/a 2011-04-29 11:10:36,182 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0011, packet:: clientPath:null serverPath:null finished:false header:: 1,-11 replyHeader:: 1,235,0 request:: null response:: null 2011-04-29 11:10:36,183 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0011 2011-04-29 11:10:36,184 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0011 closed 2011-04-29 11:10:36,185 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@263ee73b 2011-04-29 11:10:36,182 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /fe80:0:0:0:0:0:0:1%1:56322 which had sessionid 0x12fa2738adb0011 2011-04-29 11:10:36,185 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1458)) - ignoring exception during input shutdown java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.server.NIOServerCnxn.closeSock(NIOServerCnxn.java:1454) at org.apache.zookeeper.server.NIOServerCnxn.close(NIOServerCnxn.java:1411) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:631) at org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:261) 2011-04-29 11:10:36,186 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:10:36,187 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:10:36,187 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56330 2011-04-29 11:10:36,188 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:10:36,188 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56330 client's lastZxid is 0x0 2011-04-29 11:10:36,189 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56330 2011-04-29 11:10:36,190 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0019 type:createSession cxid:0x0 zxid:0xec txntype:-10 reqpath:n/a 2011-04-29 11:10:36,190 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0019 type:createSession cxid:0x0 zxid:0xec txntype:-10 reqpath:n/a 2011-04-29 11:10:36,191 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb0019 with negotiated timeout 40000 for client /127.0.0.1:56330 2011-04-29 11:10:36,191 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb0019, negotiated timeout = 40000 2011-04-29 11:10:36,191 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0019 type:getChildren cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace 2011-04-29 11:10:36,191 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0019 type:getChildren cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace 2011-04-29 11:10:36,192 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0019, packet:: clientPath:null serverPath:null finished:false header:: 1,8 replyHeader:: 1,236,0 request:: '/hive_zookeeper_namespace,F response:: v{} 2011-04-29 11:10:36,192 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb0019 2011-04-29 11:10:36,193 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb0019 2011-04-29 11:10:36,193 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb0019 2011-04-29 11:10:36,194 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb0019 type:closeSession cxid:0x2 zxid:0xed txntype:-11 reqpath:n/a 2011-04-29 11:10:36,194 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb0019 type:closeSession cxid:0x2 zxid:0xed txntype:-11 reqpath:n/a 2011-04-29 11:10:36,195 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56330 which had sessionid 0x12fa2738adb0019 2011-04-29 11:10:36,195 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb0019, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,237,0 request:: null response:: null 2011-04-29 11:10:36,195 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb0019 2011-04-29 11:10:36,195 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb0019 : Unable to read additional data from server sessionid 0x12fa2738adb0019, likely server has closed socket 2011-04-29 11:10:36,197 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb0019 closed 2011-04-29 11:10:36,197 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:10:36,199 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_all_databases 2011-04-29 11:10:36,203 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_tables: db=default pat=.* 2011-04-29 11:10:36,219 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src 2011-04-29 11:10:36,223 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,227 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,227 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,227 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src1 2011-04-29 11:10:36,228 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,232 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,233 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,233 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src_json 2011-04-29 11:10:36,233 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,238 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,238 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,239 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src_sequencefile 2011-04-29 11:10:36,239 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,241 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,241 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,242 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=src_thrift 2011-04-29 11:10:36,242 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,245 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,245 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,246 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=srcbucket 2011-04-29 11:10:36,246 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,251 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,251 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,251 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=srcbucket2 2011-04-29 11:10:36,252 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,254 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,255 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,255 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_indexes : db=default tbl=srcpart 2011-04-29 11:10:36,255 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,258 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,258 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,259 DEBUG metastore.ObjectStore (ObjectStore.java:listRoleNames(2044)) - Executing listAllRoleNames 2011-04-29 11:10:36,301 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(521)) - Close called on already closed client 2011-04-29 11:10:36,301 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=null 2011-04-29 11:10:36,315 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x0 2011-04-29 11:10:36,315 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x0 2011-04-29 11:10:36,315 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:10:36,316 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/0:0:0:0:0:0:0:1:21818, initiating session 2011-04-29 11:10:36,316 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /0:0:0:0:0:0:0:1%0:56331 2011-04-29 11:10:36,316 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/0:0:0:0:0:0:0:1:21818 2011-04-29 11:10:36,317 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /0:0:0:0:0:0:0:1%0:56331 client's lastZxid is 0x0 2011-04-29 11:10:36,317 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /0:0:0:0:0:0:0:1%0:56331 2011-04-29 11:10:36,318 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb001a type:createSession cxid:0x0 zxid:0xee txntype:-10 reqpath:n/a 2011-04-29 11:10:36,318 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb001a type:createSession cxid:0x0 zxid:0xee txntype:-10 reqpath:n/a 2011-04-29 11:10:36,319 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb001a with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1%0:56331 2011-04-29 11:10:36,319 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21818, sessionid = 0x12fa2738adb001a, negotiated timeout = 40000 2011-04-29 11:10:36,319 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb001a 2011-04-29 11:10:36,319 ERROR zookeeper.ClientCnxn (ClientCnxn.java:run(490)) - Error while calling watcher java.lang.NullPointerException at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:488) 2011-04-29 11:10:36,320 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb001a type:closeSession cxid:0x1 zxid:0xef txntype:-11 reqpath:n/a 2011-04-29 11:10:36,320 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb001a type:closeSession cxid:0x1 zxid:0xef txntype:-11 reqpath:n/a 2011-04-29 11:10:36,321 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /0:0:0:0:0:0:0:1%0:56331 which had sessionid 0x12fa2738adb001a 2011-04-29 11:10:36,321 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb001a, packet:: clientPath:null serverPath:null finished:false header:: 1,-11 replyHeader:: 1,239,0 request:: null response:: null 2011-04-29 11:10:36,321 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb001a 2011-04-29 11:10:36,321 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb001a : Unable to read additional data from server sessionid 0x12fa2738adb001a, likely server has closed socket 2011-04-29 11:10:36,321 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb001a closed 2011-04-29 11:10:36,322 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:10:36,322 INFO zookeeper.ZooKeeper (ZooKeeper.java:(373)) - Initiating client connection, connectString=localhost:21818 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@529b2735 2011-04-29 11:10:36,322 INFO zookeeper.ClientCnxn (ClientCnxn.java:startConnect(1000)) - Opening socket connection to server localhost/127.0.0.1:21818 2011-04-29 11:10:36,324 INFO zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(908)) - Socket connection established to localhost/127.0.0.1:21818, initiating session 2011-04-29 11:10:36,324 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(250)) - Accepted socket connection from /127.0.0.1:56332 2011-04-29 11:10:36,325 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(955)) - Session establishment request sent on localhost/127.0.0.1:21818 2011-04-29 11:10:36,327 DEBUG server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(734)) - Session establishment request from client /127.0.0.1:56332 client's lastZxid is 0x0 2011-04-29 11:10:36,327 INFO server.NIOServerCnxn (NIOServerCnxn.java:readConnectRequest(776)) - Client attempting to establish new session at /127.0.0.1:56332 2011-04-29 11:10:36,328 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb001b type:createSession cxid:0x0 zxid:0xf0 txntype:-10 reqpath:n/a 2011-04-29 11:10:36,328 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb001b type:createSession cxid:0x0 zxid:0xf0 txntype:-10 reqpath:n/a 2011-04-29 11:10:36,328 INFO server.NIOServerCnxn (NIOServerCnxn.java:finishSessionInit(1579)) - Established session 0x12fa2738adb001b with negotiated timeout 40000 for client /127.0.0.1:56332 2011-04-29 11:10:36,329 INFO zookeeper.ClientCnxn (ClientCnxn.java:readConnectResult(701)) - Session establishment complete on server localhost/127.0.0.1:21818, sessionid = 0x12fa2738adb001b, negotiated timeout = 40000 2011-04-29 11:10:36,329 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb001b type:getChildren cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace 2011-04-29 11:10:36,329 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb001b type:getChildren cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:/hive_zookeeper_namespace 2011-04-29 11:10:36,330 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb001b, packet:: clientPath:null serverPath:null finished:false header:: 1,8 replyHeader:: 1,240,0 request:: '/hive_zookeeper_namespace,F response:: v{} 2011-04-29 11:10:36,330 DEBUG zookeeper.ZooKeeper (ZooKeeper.java:close(527)) - Closing session: 0x12fa2738adb001b 2011-04-29 11:10:36,330 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:close(1246)) - Closing client for session: 0x12fa2738adb001b 2011-04-29 11:10:36,330 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest(385)) - Processed session termination for sessionid: 0x12fa2738adb001b 2011-04-29 11:10:36,331 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(78)) - Processing request:: sessionid:0x12fa2738adb001b type:closeSession cxid:0x2 zxid:0xf1 txntype:-11 reqpath:n/a 2011-04-29 11:10:36,331 DEBUG server.FinalRequestProcessor (FinalRequestProcessor.java:processRequest(160)) - sessionid:0x12fa2738adb001b type:closeSession cxid:0x2 zxid:0xf1 txntype:-11 reqpath:n/a 2011-04-29 11:10:36,332 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /127.0.0.1:56332 which had sessionid 0x12fa2738adb001b 2011-04-29 11:10:36,332 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:readResponse(797)) - Reading reply sessionid:0x12fa2738adb001b, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,241,0 request:: null response:: null 2011-04-29 11:10:36,332 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:disconnect(1230)) - Disconnecting client for session: 0x12fa2738adb001b 2011-04-29 11:10:36,332 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:run(1106)) - An exception was thrown while closing send thread for session 0x12fa2738adb001b : Unable to read additional data from server sessionid 0x12fa2738adb001b, likely server has closed socket 2011-04-29 11:10:36,332 INFO zookeeper.ZooKeeper (ZooKeeper.java:close(538)) - Session: 0x12fa2738adb001b closed 2011-04-29 11:10:36,334 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143) 2011-04-29 11:10:36,334 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src 2011-04-29 11:10:36,361 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=src 2011-04-29 11:10:36,361 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src 2011-04-29 11:10:36,369 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,371 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,371 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,373 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:36,376 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:36,376 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:36,376 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:36,378 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:36,379 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:36,379 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:36,387 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:36,387 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:36,388 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:36,390 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,391 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,391 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:36,394 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:36,394 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:36,402 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src 2011-04-29 11:10:36,403 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src 2011-04-29 11:10:36,404 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src1 2011-04-29 11:10:36,416 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=src1 2011-04-29 11:10:36,417 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src1 2011-04-29 11:10:36,425 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,427 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,427 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,429 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:36,431 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:36,431 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:36,431 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:36,434 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:36,434 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:36,434 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:36,437 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:36,437 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:36,438 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:36,440 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,440 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,440 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:36,443 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:36,444 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:36,452 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src1 2011-04-29 11:10:36,453 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src1 2011-04-29 11:10:36,453 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_json 2011-04-29 11:10:36,464 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=src_json 2011-04-29 11:10:36,464 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_json 2011-04-29 11:10:36,471 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,473 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,474 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,475 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:36,477 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:36,477 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:36,477 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:36,479 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:36,479 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:36,480 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:36,481 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:36,482 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:36,482 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:36,483 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,484 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,484 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:36,490 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:36,490 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:36,501 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_json 2011-04-29 11:10:36,502 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_json 2011-04-29 11:10:36,502 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_thrift 2011-04-29 11:10:36,513 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=src_thrift 2011-04-29 11:10:36,513 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_thrift 2011-04-29 11:10:36,519 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,521 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,521 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,522 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:36,524 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:36,524 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:36,525 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:36,526 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:36,526 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:36,527 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:36,529 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:36,529 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:36,529 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:36,531 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,531 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,531 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:36,533 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:36,534 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:36,541 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_thrift 2011-04-29 11:10:36,542 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_thrift 2011-04-29 11:10:36,542 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_sequencefile 2011-04-29 11:10:36,556 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=src_sequencefile 2011-04-29 11:10:36,557 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=src_sequencefile 2011-04-29 11:10:36,571 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,573 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,574 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,576 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:36,579 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:36,579 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:36,579 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:36,581 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:36,582 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:36,582 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:36,584 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:36,585 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:36,585 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:36,590 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,590 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,590 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:36,593 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:36,594 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:36,603 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_sequencefile 2011-04-29 11:10:36,605 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/src_sequencefile 2011-04-29 11:10:36,605 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:10:36,648 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=srcpart 2011-04-29 11:10:36,649 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcpart 2011-04-29 11:10:36,656 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,658 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,658 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,659 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:36,661 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:36,661 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:36,661 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:36,663 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:36,663 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:36,663 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:36,665 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:36,666 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:36,666 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:36,668 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,668 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,668 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:36,671 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:36,709 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:36,779 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcpart 2011-04-29 11:10:36,782 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcpart 2011-04-29 11:10:36,782 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:10:36,794 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=srcbucket 2011-04-29 11:10:36,794 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket 2011-04-29 11:10:36,802 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,804 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,804 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,806 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:36,808 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:36,808 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:36,808 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:36,810 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:36,810 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:36,810 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:36,812 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:36,812 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:36,812 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:36,814 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,814 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,814 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:36,816 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:36,816 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:36,824 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcbucket 2011-04-29 11:10:36,825 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcbucket 2011-04-29 11:10:36,825 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:10:36,836 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: drop_table : db=default tbl=srcbucket2 2011-04-29 11:10:36,836 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=srcbucket2 2011-04-29 11:10:36,844 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1733)) - Executing listMIndexes 2011-04-29 11:10:36,845 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1740)) - Done executing query for listMIndexes 2011-04-29 11:10:36,846 DEBUG metastore.ObjectStore (ObjectStore.java:listMIndexes(1743)) - Done retrieving all objects for listMIndexes 2011-04-29 11:10:36,847 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2924)) - Executing listAllTableGrants 2011-04-29 11:10:36,849 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2932)) - Done executing query for listAllTableGrants 2011-04-29 11:10:36,849 DEBUG metastore.ObjectStore (ObjectStore.java:listAllTableGrants(2935)) - Done retrieving all objects for listAllTableGrants 2011-04-29 11:10:36,849 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2985)) - Executing listTableAllColumnGrants 2011-04-29 11:10:36,850 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2991)) - Done executing query for listTableAllColumnGrants 2011-04-29 11:10:36,851 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllColumnGrants(2994)) - Done retrieving all objects for listTableAllColumnGrants 2011-04-29 11:10:36,851 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2954)) - Executing listTableAllPartitionGrants 2011-04-29 11:10:36,852 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2962)) - Done executing query for listTableAllPartitionGrants 2011-04-29 11:10:36,853 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionGrants(2965)) - Done retrieving all objects for listTableAllPartitionGrants 2011-04-29 11:10:36,853 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3013)) - Executing listTableAllPartitionColumnGrants 2011-04-29 11:10:36,855 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3019)) - Done executing query for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,855 DEBUG metastore.ObjectStore (ObjectStore.java:listTableAllPartitionColumnGrants(3022)) - Done retrieving all objects for listTableAllPartitionColumnGrants 2011-04-29 11:10:36,855 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1243)) - Executing listMPartitions 2011-04-29 11:10:36,857 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1251)) - Done executing query for listMPartitions 2011-04-29 11:10:36,858 DEBUG metastore.ObjectStore (ObjectStore.java:listMPartitions(1254)) - Done retrieving all objects for listMPartitions 2011-04-29 11:10:36,868 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(39)) - deleting pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcbucket2 2011-04-29 11:10:36,870 INFO metastore.hivemetastoressimpl (HiveMetaStoreFsImpl.java:deleteDir(55)) - Deleted the diretory pfile:/Users/rmelick/hive/build/ql/test/data/warehouse/srcbucket2 2011-04-29 11:10:36,870 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest1 2011-04-29 11:10:36,872 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest2 2011-04-29 11:10:36,877 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest3 2011-04-29 11:10:36,885 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest4 2011-04-29 11:10:36,887 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest4_sequencefile 2011-04-29 11:10:36,889 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest_j1 2011-04-29 11:10:36,891 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest_j2 2011-04-29 11:10:36,905 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest_g1 2011-04-29 11:10:36,907 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=dest_g2 2011-04-29 11:10:36,909 INFO metastore.HiveMetaStore (HiveMetaStore.java:logInfo(475)) - 0: get_table : db=default tbl=fetchtask_ioexception 2011-04-29 11:10:36,911 INFO server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1434)) - Closed socket connection for client /0:0:0:0:0:0:0:1%0:56321 which had sessionid 0x12fa2738adb0010 2011-04-29 11:10:36,911 INFO server.NIOServerCnxn (NIOServerCnxn.java:run(277)) - NIOServerCnxn factory exited run method 2011-04-29 11:10:36,911 INFO zookeeper.ClientCnxn (ClientCnxn.java:run(1118)) - Unable to read additional data from server sessionid 0x12fa2738adb0010, likely server has closed socket, closing socket connection and attempting reconnect 2011-04-29 11:10:36,911 DEBUG zookeeper.ClientCnxn (ClientCnxn.java:cleanup(1167)) - Ignoring exception during shutdown input java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:633) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1164) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1129) 2011-04-29 11:10:36,912 INFO server.PrepRequestProcessor (PrepRequestProcessor.java:run(119)) - PrepRequestProcessor exited loop! 2011-04-29 11:10:36,912 INFO server.SyncRequestProcessor (SyncRequestProcessor.java:run(151)) - SyncRequestProcessor exited! 2011-04-29 11:10:36,917 INFO server.FinalRequestProcessor (FinalRequestProcessor.java:shutdown(378)) - shutdown of request processor complete