2015-08-14 07:24:40,412 INFO [main] hbase.PerformanceEvaluation: RandomReadTest test run options={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":10,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":0,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,040 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2015-08-14 07:24:41,180 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5428179e connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:41,187 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 2015-08-14 07:24:41,187 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=matts-mbp 2015-08-14 07:24:41,188 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.7.0_71 2015-08-14 07:24:41,188 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2015-08-14 07:24:41,188 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.7.0_71.jdk/Contents/Home/jre 2015-08-14 07:24:41,188 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/Users/mattwarhaftig/Documents/git/hbase/bin/../conf:/Library/Java/JavaVirtualMachines/jdk1.7.0_71.jdk/Contents/Home/lib/tools.jar:/Users/mattwarhaftig/Documents/git/hbase/bin/../hbase-server/target:/Users/mattwarhaftig/Documents/git/hbase/hbase-it/target/hbase-it-2.0.0-SNAPSHOT-tests.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-common/target/hbase-common-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-protocol/target/hbase-protocol-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-client/target/hbase-client-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/mattwarhaftig/.m2/repository/org/jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/mattwarhaftig/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar:/Users/mattwarhaftig/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/mattwarhaftig/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/Users/mattwarhaftig/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/Users/mattwarhaftig/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/Users/mattwarhaftig/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/mattwarhaftig/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/Users/mattwarhaftig/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/mattwarhaftig/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/Users/mattwarhaftig/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/Users/mattwarhaftig/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/Users/mattwarhaftig/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/Users/mattwarhaftig/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar:/Users/mattwarhaftig/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar:/Users/mattwarhaftig/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/mattwarhaftig/.m2/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-annotations/2.5.1/hadoop-annotations-2.5.1.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_71.jdk/Contents/Home/jre/../lib/tools.jar:/Users/mattwarhaftig/.m2/repository/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/mattwarhaftig/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/mattwarhaftig/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/Users/mattwarhaftig/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/Users/mattwarhaftig/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/Users/mattwarhaftig/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/Users/mattwarhaftig/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/Users/mattwarhaftig/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/Users/mattwarhaftig/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/mattwarhaftig/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/mattwarhaftig/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/Users/mattwarhaftig/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-server/target/hbase-server-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-procedure/target/hbase-procedure-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-prefix-tree/target/hbase-prefix-tree-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/mattwarhaftig/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/Users/mattwarhaftig/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/Users/mattwarhaftig/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/mattwarhaftig/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/Users/mattwarhaftig/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar:/Users/mattwarhaftig/.m2/repository/asm/asm/3.1/asm-3.1.jar:/Users/mattwarhaftig/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/mattwarhaftig/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/mattwarhaftig/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/Users/mattwarhaftig/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/mattwarhaftig/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/Users/mattwarhaftig/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/Users/mattwarhaftig/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/Users/mattwarhaftig/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/Users/mattwarhaftig/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/Users/mattwarhaftig/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/Users/mattwarhaftig/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/Users/mattwarhaftig/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/Users/mattwarhaftig/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/Users/mattwarhaftig/.m2/repository/org/jamon/jamon-runtime/2.3.1/jamon-runtime-2.3.1.jar:/Users/mattwarhaftig/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/Users/mattwarhaftig/.m2/repository/com/lmax/disruptor/3.3.0/disruptor-3.3.0.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/mattwarhaftig/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/mattwarhaftig/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/mattwarhaftig/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/mattwarhaftig/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-client/2.5.1/hadoop-client-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.5.1/hadoop-mapreduce-client-app-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.5.1/hadoop-hdfs-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/commons-daemon/commons-daemon/1.0.13/commons-daemon-1.0.13.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-hadoop-compat/target/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-annotations/target/hbase-annotations-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-shell/target/hbase-shell-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/.m2/repository/org/jruby/jruby-complete/1.6.8/jruby-complete-1.6.8.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-thrift/target/hbase-thrift-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/thrift/libthrift/0.9.2/libthrift-0.9.2.jar:/Users/mattwarhaftig/.m2/repository/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/mattwarhaftig/.m2/repository/org/slf4j/slf4j-api/1.7.7/slf4j-api-1.7.7.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-rest/target/hbase-rest-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar:/Users/mattwarhaftig/.m2/repository/org/codehaus/jettison/jettison/1.3.3/jettison-1.3.3.jar:/Users/mattwarhaftig/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/Users/mattwarhaftig/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/Users/mattwarhaftig/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/mattwarhaftig/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-testing-util/target/hbase-testing-util-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-common/target/hbase-common-2.0.0-SNAPSHOT-tests.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-annotations/target/hbase-annotations-2.0.0-SNAPSHOT-tests.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-server/target/hbase-server-2.0.0-SNAPSHOT-tests.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-hadoop-compat/target/hbase-hadoop-compat-2.0.0-SNAPSHOT-tests.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.0.0-SNAPSHOT-tests.jar:/Users/mattwarhaftig/.m2/repository/org/slf4j/slf4j-log4j12/1.7.7/slf4j-log4j12-1.7.7.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.5.1/hadoop-mapreduce-client-jobclient-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.5.1/hadoop-mapreduce-client-common-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.5.1/hadoop-yarn-client-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.5.1/hadoop-yarn-server-common-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.5.1/hadoop-mapreduce-client-shuffle-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-server-nodemanager/2.5.1/hadoop-yarn-server-nodemanager-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.5.1/hadoop-hdfs-2.5.1-tests.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-minicluster/2.5.1/hadoop-minicluster-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1-tests.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-server-tests/2.5.1/hadoop-yarn-server-tests-2.5.1-tests.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-server-resourcemanager/2.5.1/hadoop-yarn-server-resourcemanager-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-server-applicationhistoryservice/2.5.1/hadoop-yarn-server-applicationhistoryservice-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-yarn-server-web-proxy/2.5.1/hadoop-yarn-server-web-proxy-2.5.1.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.5.1/hadoop-mapreduce-client-jobclient-2.5.1-tests.jar:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-hs/2.5.1/hadoop-mapreduce-client-hs-2.5.1.jar:/Users/mattwarhaftig/Documents/git/hbase/hbase-resource-bundle/target/hbase-resource-bundle-2.0.0-SNAPSHOT.jar:/Users/mattwarhaftig/.m2/repository/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/Users/mattwarhaftig/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/mattwarhaftig/.m2/repository/junit/junit/4.11/junit-4.11.jar:/Users/mattwarhaftig/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/Users/mattwarhaftig/.m2/repository/org/mockito/mockito-all/1.10.8/mockito-all-1.10.8.jar:/Users/mattwarhaftig/.m2/repository/org/jmock/jmock-junit4/2.6.0/jmock-junit4-2.6.0.jar:/Users/mattwarhaftig/.m2/repository/org/jmock/jmock/2.6.0/jmock-2.6.0.jar:/Users/mattwarhaftig/.m2/repository/org/hamcrest/hamcrest-library/1.1/hamcrest-library-1.1.jar:/Users/mattwarhaftig/Documents/git/hbase/bin/../lib/*.jar: 2015-08-14 07:24:41,188 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=/Users/mattwarhaftig/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. 2015-08-14 07:24:41,188 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/var/folders/cy/s6h24bbx407gn1mkwcttwrgw0000gq/T/ 2015-08-14 07:24:41,188 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2015-08-14 07:24:41,188 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Mac OS X 2015-08-14 07:24:41,189 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=x86_64 2015-08-14 07:24:41,189 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=10.10.4 2015-08-14 07:24:41,189 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=mattwarhaftig 2015-08-14 07:24:41,189 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/Users/mattwarhaftig 2015-08-14 07:24:41,189 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/Users/mattwarhaftig/Documents/git/hbase 2015-08-14 07:24:41,190 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x5428179e0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:41,217 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:41,229 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 2015-08-14 07:24:41,240 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14f2bd670de004a, negotiated timeout = 40000 2015-08-14 07:24:41,893 INFO [main] client.ConnectionImplementation: Closing master protocol: MasterService 2015-08-14 07:24:41,893 INFO [main] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de004a 2015-08-14 07:24:41,894 INFO [main] zookeeper.ZooKeeper: Session: 0x14f2bd670de004a closed 2015-08-14 07:24:41,896 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:41,928 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=0, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":0,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,929 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=1, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":100,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,929 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=2, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":200,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,929 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=3, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":300,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,929 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=4, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":400,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,930 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=5, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":500,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,930 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=6, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":600,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,930 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=7, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":700,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,930 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=8, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":800,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,931 INFO [main] hbase.PerformanceEvaluation: Client=0, maptask=9, input={"addColumns":true,"autoFlush":false,"blockEncoding":"NONE","bloomType":"ROW","caching":30,"cmdName":"randomRead","columns":1,"compression":"NONE","cycles":1,"filterAll":false,"flushCommits":true,"inMemoryCF":false,"measureAfter":0,"multiGet":0,"noOfTags":1,"nomapred":false,"numClientThreads":1,"oneCon":false,"perClientRunRows":1,"period":104857,"presplitRegions":0,"randomSleep":0,"replicas":1,"reportLatency":false,"rowRangeSize":100,"sampleRate":1.0,"size":0.0,"splitPolicy":null,"startRow":900,"tableName":"TestTable","totalRows":1000,"traceRate":0.0,"useTags":false,"valueRandom":false,"valueSize":1000,"valueZipf":false,"writeToWAL":true} 2015-08-14 07:24:41,982 INFO [main] Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id 2015-08-14 07:24:41,982 INFO [main] jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 2015-08-14 07:24:42,660 INFO [main] input.FileInputFormat: Total input paths to process : 1 2015-08-14 07:24:42,692 INFO [main] mapreduce.JobSubmitter: number of splits:10 2015-08-14 07:24:42,872 INFO [main] mapreduce.JobSubmitter: Submitting tokens for job: job_local108473650_0001 2015-08-14 07:24:42,900 WARN [main] conf.Configuration: file:/tmp/hadoop-mattwarhaftig/mapred/staging/mattwarhaftig108473650/.staging/job_local108473650_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. 2015-08-14 07:24:42,907 WARN [main] conf.Configuration: file:/tmp/hadoop-mattwarhaftig/mapred/staging/mattwarhaftig108473650/.staging/job_local108473650_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. 2015-08-14 07:24:43,316 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482953/hbase-protocol-2.0.0-SNAPSHOT.jar <- /Users/mattwarhaftig/Documents/git/hbase/hbase-protocol-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,334 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/Documents/git/hbase/hbase-protocol/target/hbase-protocol-2.0.0-SNAPSHOT.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482953/hbase-protocol-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,492 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482954/jackson-mapper-asl-1.9.13.jar <- /Users/mattwarhaftig/Documents/git/hbase/jackson-mapper-asl-1.9.13.jar 2015-08-14 07:24:43,530 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482954/jackson-mapper-asl-1.9.13.jar 2015-08-14 07:24:43,530 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482955/hbase-common-2.0.0-SNAPSHOT.jar <- /Users/mattwarhaftig/Documents/git/hbase/hbase-common-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,539 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/Documents/git/hbase/hbase-common/target/hbase-common-2.0.0-SNAPSHOT.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482955/hbase-common-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,540 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482956/metrics-core-2.2.0.jar <- /Users/mattwarhaftig/Documents/git/hbase/metrics-core-2.2.0.jar 2015-08-14 07:24:43,549 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482956/metrics-core-2.2.0.jar 2015-08-14 07:24:43,589 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482957/netty-all-4.0.23.Final.jar <- /Users/mattwarhaftig/Documents/git/hbase/netty-all-4.0.23.Final.jar 2015-08-14 07:24:43,601 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482957/netty-all-4.0.23.Final.jar 2015-08-14 07:24:43,652 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482958/hadoop-common-2.5.1.jar <- /Users/mattwarhaftig/Documents/git/hbase/hadoop-common-2.5.1.jar 2015-08-14 07:24:43,658 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482958/hadoop-common-2.5.1.jar 2015-08-14 07:24:43,658 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482959/protobuf-java-2.5.0.jar <- /Users/mattwarhaftig/Documents/git/hbase/protobuf-java-2.5.0.jar 2015-08-14 07:24:43,667 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482959/protobuf-java-2.5.0.jar 2015-08-14 07:24:43,667 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482960/hbase-server-2.0.0-SNAPSHOT.jar <- /Users/mattwarhaftig/Documents/git/hbase/hbase-server-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,673 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/Documents/git/hbase/hbase-server/target/hbase-server-2.0.0-SNAPSHOT.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482960/hbase-server-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,674 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482961/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar <- /Users/mattwarhaftig/Documents/git/hbase/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,679 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/Documents/git/hbase/hbase-hadoop-compat/target/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482961/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,679 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482962/hadoop-mapreduce-client-core-2.5.1.jar <- /Users/mattwarhaftig/Documents/git/hbase/hadoop-mapreduce-client-core-2.5.1.jar 2015-08-14 07:24:43,684 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-2.5.1.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482962/hadoop-mapreduce-client-core-2.5.1.jar 2015-08-14 07:24:43,684 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482963/guava-12.0.1.jar <- /Users/mattwarhaftig/Documents/git/hbase/guava-12.0.1.jar 2015-08-14 07:24:43,690 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482963/guava-12.0.1.jar 2015-08-14 07:24:43,690 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482964/hbase-client-2.0.0-SNAPSHOT.jar <- /Users/mattwarhaftig/Documents/git/hbase/hbase-client-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,696 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/Documents/git/hbase/hbase-client/target/hbase-client-2.0.0-SNAPSHOT.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482964/hbase-client-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,696 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482965/htrace-core-3.1.0-incubating.jar <- /Users/mattwarhaftig/Documents/git/hbase/htrace-core-3.1.0-incubating.jar 2015-08-14 07:24:43,700 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482965/htrace-core-3.1.0-incubating.jar 2015-08-14 07:24:43,700 INFO [main] mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-mattwarhaftig/mapred/local/1439551482966/zookeeper-3.4.6.jar <- /Users/mattwarhaftig/Documents/git/hbase/zookeeper-3.4.6.jar 2015-08-14 07:24:43,706 INFO [main] mapred.LocalDistributedCacheManager: Localized file:/Users/mattwarhaftig/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar as file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482966/zookeeper-3.4.6.jar 2015-08-14 07:24:43,798 WARN [main] conf.Configuration: file:/tmp/hadoop-mattwarhaftig/mapred/local/localRunner/mattwarhaftig/job_local108473650_0001/job_local108473650_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. 2015-08-14 07:24:43,804 WARN [main] conf.Configuration: file:/tmp/hadoop-mattwarhaftig/mapred/local/localRunner/mattwarhaftig/job_local108473650_0001/job_local108473650_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482953/hbase-protocol-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482954/jackson-mapper-asl-1.9.13.jar 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482955/hbase-common-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482956/metrics-core-2.2.0.jar 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482957/netty-all-4.0.23.Final.jar 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482958/hadoop-common-2.5.1.jar 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482959/protobuf-java-2.5.0.jar 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482960/hbase-server-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,805 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482961/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,806 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482962/hadoop-mapreduce-client-core-2.5.1.jar 2015-08-14 07:24:43,806 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482963/guava-12.0.1.jar 2015-08-14 07:24:43,806 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482964/hbase-client-2.0.0-SNAPSHOT.jar 2015-08-14 07:24:43,806 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482965/htrace-core-3.1.0-incubating.jar 2015-08-14 07:24:43,806 INFO [main] mapred.LocalDistributedCacheManager: file:/tmp/hadoop-mattwarhaftig/mapred/local/1439551482966/zookeeper-3.4.6.jar 2015-08-14 07:24:43,811 INFO [main] mapreduce.Job: The url to track the job: http://localhost:8080/ 2015-08-14 07:24:43,811 INFO [main] mapreduce.Job: Running job: job_local108473650_0001 2015-08-14 07:24:43,812 INFO [Thread-80] mapred.LocalJobRunner: OutputCommitter set in config null 2015-08-14 07:24:43,824 INFO [Thread-80] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 2015-08-14 07:24:43,868 INFO [Thread-80] mapred.LocalJobRunner: Waiting for map tasks 2015-08-14 07:24:43,868 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000000_0 2015-08-14 07:24:43,909 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:43,909 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:43,914 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:646+647 2015-08-14 07:24:43,929 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:44,047 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:44,047 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:44,047 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:44,047 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:44,047 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:44,142 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x3588802f connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,142 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x3588802f0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,144 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,144 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:44,145 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de004b, negotiated timeout = 40000 2015-08-14 07:24:44,148 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:44,149 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7510a4da connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,149 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x7510a4da0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,150 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,150 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 2015-08-14 07:24:44,152 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14f2bd670de004c, negotiated timeout = 40000 2015-08-14 07:24:44,182 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:44,206 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000014"} 2015-08-14 07:24:44,266 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de004c 2015-08-14 07:24:44,267 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de004c closed 2015-08-14 07:24:44,267 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:44,272 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:44,273 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:44,273 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:44,273 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:44,273 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:44,278 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:44,281 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000000_0 is done. And is in the process of committing 2015-08-14 07:24:44,287 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 85ms at offset 500 for 1 rows from a range of 100 rows (0.01 MB/s) 2015-08-14 07:24:44,287 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000000_0' done. 2015-08-14 07:24:44,287 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000000_0 2015-08-14 07:24:44,287 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000001_0 2015-08-14 07:24:44,288 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:44,288 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:44,289 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:1293+647 2015-08-14 07:24:44,289 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:44,369 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:44,369 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:44,369 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:44,369 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:44,369 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:44,396 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x53cc3ac7 connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,396 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x53cc3ac70x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,397 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,398 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 2015-08-14 07:24:44,400 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14f2bd670de004d, negotiated timeout = 40000 2015-08-14 07:24:44,402 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:44,402 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x4b0f573b connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,402 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x4b0f573b0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,403 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,404 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 2015-08-14 07:24:44,405 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14f2bd670de004e, negotiated timeout = 40000 2015-08-14 07:24:44,426 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:44,426 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000063"} 2015-08-14 07:24:44,439 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de004e 2015-08-14 07:24:44,440 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de004e closed 2015-08-14 07:24:44,440 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:44,441 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:44,441 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:44,441 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:44,441 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:44,441 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:44,443 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:44,444 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000001_0 is done. And is in the process of committing 2015-08-14 07:24:44,445 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 14ms at offset 600 for 1 rows from a range of 100 rows (0.07 MB/s) 2015-08-14 07:24:44,445 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000001_0' done. 2015-08-14 07:24:44,445 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000001_0 2015-08-14 07:24:44,445 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000002_0 2015-08-14 07:24:44,446 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:44,446 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:44,447 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:1940+647 2015-08-14 07:24:44,447 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:44,523 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:44,523 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:44,523 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:44,523 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:44,523 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:44,559 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x69f11d connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,559 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x69f11d0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,559 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,560 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:44,561 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de004f, negotiated timeout = 40000 2015-08-14 07:24:44,562 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:44,563 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x2bcd64dd connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,563 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x2bcd64dd0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,564 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,564 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:44,566 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0050, negotiated timeout = 40000 2015-08-14 07:24:44,587 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:44,588 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000007"} 2015-08-14 07:24:44,608 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de0050 2015-08-14 07:24:44,609 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de0050 closed 2015-08-14 07:24:44,609 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:44,610 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:44,610 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:44,610 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:44,610 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:44,610 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:44,612 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:44,614 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000002_0 is done. And is in the process of committing 2015-08-14 07:24:44,615 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 22ms at offset 800 for 1 rows from a range of 100 rows (0.04 MB/s) 2015-08-14 07:24:44,615 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000002_0' done. 2015-08-14 07:24:44,615 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000002_0 2015-08-14 07:24:44,615 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000003_0 2015-08-14 07:24:44,616 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:44,616 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:44,617 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:2587+647 2015-08-14 07:24:44,617 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:44,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:44,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:44,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:44,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:44,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:44,718 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x36e8f73d connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,719 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x36e8f73d0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,719 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,723 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:44,724 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0051, negotiated timeout = 40000 2015-08-14 07:24:44,726 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:44,727 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x66cde5cb connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,727 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x66cde5cb0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,728 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,728 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 2015-08-14 07:24:44,729 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14f2bd670de0052, negotiated timeout = 40000 2015-08-14 07:24:44,752 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:44,752 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000043"} 2015-08-14 07:24:44,764 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de0052 2015-08-14 07:24:44,765 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de0052 closed 2015-08-14 07:24:44,765 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:44,766 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:44,767 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:44,767 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:44,767 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:44,767 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:44,768 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:44,770 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000003_0 is done. And is in the process of committing 2015-08-14 07:24:44,771 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 14ms at offset 300 for 1 rows from a range of 100 rows (0.07 MB/s) 2015-08-14 07:24:44,771 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000003_0' done. 2015-08-14 07:24:44,771 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000003_0 2015-08-14 07:24:44,771 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000004_0 2015-08-14 07:24:44,773 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:44,773 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:44,774 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:3234+647 2015-08-14 07:24:44,774 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:44,836 INFO [main] mapreduce.Job: Job job_local108473650_0001 running in uber mode : false 2015-08-14 07:24:44,838 INFO [main] mapreduce.Job: map 100% reduce 0% 2015-08-14 07:24:44,850 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:44,850 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:44,850 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:44,850 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:44,850 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:44,880 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0xb85e47a connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,880 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0xb85e47a0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,881 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,885 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:44,886 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0053, negotiated timeout = 40000 2015-08-14 07:24:44,888 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:44,889 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x452ec8e0 connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:44,889 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x452ec8e00x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:44,890 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:44,890 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:44,891 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0054, negotiated timeout = 40000 2015-08-14 07:24:44,914 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:44,914 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000090"} 2015-08-14 07:24:44,926 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de0054 2015-08-14 07:24:44,927 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de0054 closed 2015-08-14 07:24:44,927 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:44,928 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:44,928 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:44,928 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:44,928 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:44,928 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:44,931 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:44,932 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000004_0 is done. And is in the process of committing 2015-08-14 07:24:44,933 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 13ms at offset 700 for 1 rows from a range of 100 rows (0.08 MB/s) 2015-08-14 07:24:44,933 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000004_0' done. 2015-08-14 07:24:44,933 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000004_0 2015-08-14 07:24:44,933 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000005_0 2015-08-14 07:24:44,934 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:44,934 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:44,935 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:3881+647 2015-08-14 07:24:44,936 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:45,012 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:45,012 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:45,012 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:45,012 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:45,012 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:45,043 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5ea41521 connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,043 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x5ea415210x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,044 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,047 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:45,049 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0055, negotiated timeout = 40000 2015-08-14 07:24:45,050 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:45,051 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x4048affb connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,051 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x4048affb0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,052 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,052 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:45,053 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0056, negotiated timeout = 40000 2015-08-14 07:24:45,075 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:45,075 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000076"} 2015-08-14 07:24:45,086 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de0056 2015-08-14 07:24:45,087 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de0056 closed 2015-08-14 07:24:45,087 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:45,088 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:45,088 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:45,089 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:45,089 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:45,089 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:45,090 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:45,092 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000005_0 is done. And is in the process of committing 2015-08-14 07:24:45,093 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 12ms at offset 100 for 1 rows from a range of 100 rows (0.08 MB/s) 2015-08-14 07:24:45,093 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000005_0' done. 2015-08-14 07:24:45,093 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000005_0 2015-08-14 07:24:45,093 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000006_0 2015-08-14 07:24:45,094 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:45,094 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:45,095 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:4528+647 2015-08-14 07:24:45,095 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:45,175 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:45,175 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:45,175 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:45,175 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:45,175 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:45,204 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x4f43d53c connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,204 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x4f43d53c0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,205 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,206 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:45,213 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0057, negotiated timeout = 40000 2015-08-14 07:24:45,215 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:45,217 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x78b2fe03 connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,217 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x78b2fe030x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,218 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,219 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:45,220 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0058, negotiated timeout = 40000 2015-08-14 07:24:45,243 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:45,243 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000054"} 2015-08-14 07:24:45,259 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de0058 2015-08-14 07:24:45,260 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de0058 closed 2015-08-14 07:24:45,261 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:45,261 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:45,261 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:45,262 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:45,262 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:45,262 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:45,264 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:45,265 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000006_0 is done. And is in the process of committing 2015-08-14 07:24:45,267 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 17ms at offset 200 for 1 rows from a range of 100 rows (0.06 MB/s) 2015-08-14 07:24:45,267 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000006_0' done. 2015-08-14 07:24:45,267 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000006_0 2015-08-14 07:24:45,267 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000007_0 2015-08-14 07:24:45,268 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:45,268 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:45,269 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:5175+647 2015-08-14 07:24:45,270 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:45,346 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:45,346 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:45,346 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:45,346 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:45,346 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:45,373 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5ca83ed0 connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,373 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x5ca83ed00x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,375 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,375 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:45,383 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de0059, negotiated timeout = 40000 2015-08-14 07:24:45,386 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:45,386 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7d3772b6 connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,387 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x7d3772b60x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,388 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,388 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:45,389 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de005a, negotiated timeout = 40000 2015-08-14 07:24:45,412 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:45,412 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000016"} 2015-08-14 07:24:45,424 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de005a 2015-08-14 07:24:45,425 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de005a closed 2015-08-14 07:24:45,425 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:45,426 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:45,426 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:45,426 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:45,426 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:45,426 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:45,428 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:45,430 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000007_0 is done. And is in the process of committing 2015-08-14 07:24:45,431 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 13ms at offset 400 for 1 rows from a range of 100 rows (0.08 MB/s) 2015-08-14 07:24:45,432 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000007_0' done. 2015-08-14 07:24:45,432 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000007_0 2015-08-14 07:24:45,432 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000008_0 2015-08-14 07:24:45,433 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:45,433 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:45,434 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:0+646 2015-08-14 07:24:45,434 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:45,509 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:45,509 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:45,509 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:45,509 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:45,509 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:45,540 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x115faadb connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,541 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x115faadb0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,542 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,548 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:45,549 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de005b, negotiated timeout = 40000 2015-08-14 07:24:45,551 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:45,552 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x9fb03df connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,552 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x9fb03df0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,553 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,554 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 2015-08-14 07:24:45,555 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14f2bd670de005c, negotiated timeout = 40000 2015-08-14 07:24:45,577 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:45,577 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000015"} 2015-08-14 07:24:45,589 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de005c 2015-08-14 07:24:45,590 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de005c closed 2015-08-14 07:24:45,590 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:45,591 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:45,591 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:45,591 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:45,591 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:45,591 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:45,593 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:45,595 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000008_0 is done. And is in the process of committing 2015-08-14 07:24:45,596 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 13ms at offset 900 for 1 rows from a range of 100 rows (0.08 MB/s) 2015-08-14 07:24:45,596 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000008_0' done. 2015-08-14 07:24:45,596 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000008_0 2015-08-14 07:24:45,596 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_m_000009_0 2015-08-14 07:24:45,597 INFO [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:45,597 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:45,598 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/inputs/input.txt:5822+645 2015-08-14 07:24:45,599 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2015-08-14 07:24:45,673 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2015-08-14 07:24:45,673 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2015-08-14 07:24:45,673 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2015-08-14 07:24:45,673 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2015-08-14 07:24:45,673 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2015-08-14 07:24:45,709 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x4f4b261e connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,709 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x4f4b261e0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,710 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,714 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-08-14 07:24:45,715 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14f2bd670de005d, negotiated timeout = 40000 2015-08-14 07:24:45,717 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Sampling 1 every 1 out of 1 total rows. 2015-08-14 07:24:45,717 INFO [LocalJobRunner Map Task Executor #0] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5959194b connecting to ZooKeeper ensemble=localhost:2181 2015-08-14 07:24:45,717 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x5959194b0x0, quorum=localhost:2181, baseZNode=/hbase 2015-08-14 07:24:45,718 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 2015-08-14 07:24:45,719 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 2015-08-14 07:24:45,720 INFO [LocalJobRunner Map Task Executor #0-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14f2bd670de005e, negotiated timeout = 40000 2015-08-14 07:24:45,743 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: Timed test starting in thread LocalJobRunner Map Task Executor #0 2015-08-14 07:24:45,744 INFO [LocalJobRunner Map Task Executor #0] hbase.PerformanceEvaluation: {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"info":["0"]},"maxVersions":1,"row":"00000000000000000000000088"} 2015-08-14 07:24:45,755 INFO [LocalJobRunner Map Task Executor #0] client.ConnectionImplementation: Closing zookeeper sessionid=0x14f2bd670de005e 2015-08-14 07:24:45,756 INFO [LocalJobRunner Map Task Executor #0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2015-08-14 07:24:45,756 INFO [LocalJobRunner Map Task Executor #0] zookeeper.ZooKeeper: Session: 0x14f2bd670de005e closed 2015-08-14 07:24:45,757 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2015-08-14 07:24:45,757 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2015-08-14 07:24:45,757 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2015-08-14 07:24:45,757 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 16; bufvoid = 104857600 2015-08-14 07:24:45,757 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2015-08-14 07:24:45,759 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2015-08-14 07:24:45,761 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local108473650_0001_m_000009_0 is done. And is in the process of committing 2015-08-14 07:24:45,763 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest in 13ms at offset 0 for 1 rows from a range of 100 rows (0.08 MB/s) 2015-08-14 07:24:45,763 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local108473650_0001_m_000009_0' done. 2015-08-14 07:24:45,763 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_m_000009_0 2015-08-14 07:24:45,763 INFO [Thread-80] mapred.LocalJobRunner: map task executor complete. 2015-08-14 07:24:45,765 INFO [Thread-80] mapred.LocalJobRunner: Waiting for reduce tasks 2015-08-14 07:24:45,765 INFO [pool-3-thread-1] mapred.LocalJobRunner: Starting task: attempt_local108473650_0001_r_000000_0 2015-08-14 07:24:45,770 INFO [pool-3-thread-1] util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux. 2015-08-14 07:24:45,770 INFO [pool-3-thread-1] mapred.Task: Using ResourceCalculatorProcessTree : null 2015-08-14 07:24:45,772 INFO [pool-3-thread-1] mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@34c2910a 2015-08-14 07:24:45,779 INFO [pool-3-thread-1] reduce.MergeManagerImpl: MergerManager: memoryLimit=727213632, maxSingleShuffleLimit=181803408, mergeThreshold=479961024, ioSortFactor=10, memToMemMergeOutputsThreshold=10 2015-08-14 07:24:45,781 INFO [EventFetcher for fetching Map Completion Events] reduce.EventFetcher: attempt_local108473650_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events 2015-08-14 07:24:45,800 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000008_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,802 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000008_0 2015-08-14 07:24:45,826 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->20 2015-08-14 07:24:45,829 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000001_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,830 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000001_0 2015-08-14 07:24:45,830 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 2, commitMemory -> 20, usedMemory ->40 2015-08-14 07:24:45,832 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000005_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,832 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000005_0 2015-08-14 07:24:45,832 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 3, commitMemory -> 40, usedMemory ->60 2015-08-14 07:24:45,834 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000002_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,834 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000002_0 2015-08-14 07:24:45,834 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 4, commitMemory -> 60, usedMemory ->80 2015-08-14 07:24:45,836 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000000_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,836 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000000_0 2015-08-14 07:24:45,836 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 5, commitMemory -> 80, usedMemory ->100 2015-08-14 07:24:45,838 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000003_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,838 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000003_0 2015-08-14 07:24:45,838 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 6, commitMemory -> 100, usedMemory ->120 2015-08-14 07:24:45,839 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000006_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,840 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000006_0 2015-08-14 07:24:45,840 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 7, commitMemory -> 120, usedMemory ->140 2015-08-14 07:24:45,841 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000009_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,841 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000009_0 2015-08-14 07:24:45,841 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 8, commitMemory -> 140, usedMemory ->160 2015-08-14 07:24:45,843 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000004_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,843 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000004_0 2015-08-14 07:24:45,843 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 9, commitMemory -> 160, usedMemory ->180 2015-08-14 07:24:45,844 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local108473650_0001_m_000007_0 decomp: 20 len: 24 to MEMORY 2015-08-14 07:24:45,844 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 20 bytes from map-output for attempt_local108473650_0001_m_000007_0 2015-08-14 07:24:45,844 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20, inMemoryMapOutputs.size() -> 10, commitMemory -> 180, usedMemory ->200 2015-08-14 07:24:45,845 INFO [EventFetcher for fetching Map Completion Events] reduce.EventFetcher: EventFetcher is interrupted.. Returning 2015-08-14 07:24:45,845 INFO [pool-3-thread-1] mapred.LocalJobRunner: 10 / 10 copied. 2015-08-14 07:24:45,846 INFO [pool-3-thread-1] reduce.MergeManagerImpl: finalMerge called with 10 in-memory map-outputs and 0 on-disk map-outputs 2015-08-14 07:24:45,850 INFO [pool-3-thread-1] mapred.Merger: Merging 10 sorted segments 2015-08-14 07:24:45,851 INFO [pool-3-thread-1] mapred.Merger: Down to the last merge-pass, with 10 segments left of total size: 100 bytes 2015-08-14 07:24:45,852 INFO [pool-3-thread-1] reduce.MergeManagerImpl: Merged 10 segments, 200 bytes to disk to satisfy reduce memory limit 2015-08-14 07:24:45,852 INFO [pool-3-thread-1] reduce.MergeManagerImpl: Merging 1 files, 186 bytes from disk 2015-08-14 07:24:45,853 INFO [pool-3-thread-1] reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce 2015-08-14 07:24:45,853 INFO [pool-3-thread-1] mapred.Merger: Merging 1 sorted segments 2015-08-14 07:24:45,853 INFO [pool-3-thread-1] mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 172 bytes 2015-08-14 07:24:45,853 INFO [pool-3-thread-1] mapred.LocalJobRunner: 10 / 10 copied. 2015-08-14 07:24:45,863 INFO [pool-3-thread-1] Configuration.deprecation: mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords 2015-08-14 07:24:45,867 INFO [pool-3-thread-1] mapred.Task: Task:attempt_local108473650_0001_r_000000_0 is done. And is in the process of committing 2015-08-14 07:24:45,868 INFO [pool-3-thread-1] mapred.LocalJobRunner: 10 / 10 copied. 2015-08-14 07:24:45,868 INFO [pool-3-thread-1] mapred.Task: Task attempt_local108473650_0001_r_000000_0 is allowed to commit now 2015-08-14 07:24:45,871 INFO [pool-3-thread-1] output.FileOutputCommitter: Saved output of task 'attempt_local108473650_0001_r_000000_0' to file:/Users/mattwarhaftig/Documents/git/hbase/performance_evaluation/20150814072441/outputs/_temporary/0/task_local108473650_0001_r_000000 2015-08-14 07:24:45,872 INFO [pool-3-thread-1] mapred.LocalJobRunner: reduce > reduce 2015-08-14 07:24:45,872 INFO [pool-3-thread-1] mapred.Task: Task 'attempt_local108473650_0001_r_000000_0' done. 2015-08-14 07:24:45,872 INFO [pool-3-thread-1] mapred.LocalJobRunner: Finishing task: attempt_local108473650_0001_r_000000_0 2015-08-14 07:24:45,872 INFO [Thread-80] mapred.LocalJobRunner: reduce task executor complete. 2015-08-14 07:24:46,844 INFO [main] mapreduce.Job: map 100% reduce 100% 2015-08-14 07:24:46,845 INFO [main] mapreduce.Job: Job job_local108473650_0001 completed successfully 2015-08-14 07:24:46,878 INFO [main] mapreduce.Job: Counters: 32 File System Counters FILE: Number of bytes read=298987741 FILE: Number of bytes written=304518369 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Map input records=10 Map output records=10 Map output bytes=160 Map output materialized bytes=240 Input split bytes=1650 Combine input records=0 Combine output records=0 Reduce input groups=10 Reduce shuffle bytes=240 Reduce input records=10 Reduce output records=10 Spilled Records=20 Shuffled Maps =10 Failed Shuffles=0 Merged Map outputs=10 GC time elapsed (ms)=665 Total committed heap usage (bytes)=3105988608 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 HBase Performance Evaluation Elapsed time in milliseconds=216 Row count=10 File Input Format Counters Bytes Read=35796 File Output Format Counters Bytes Written=80