DEBUG StatusLogger Using ShutdownCallbackRegistry class org.apache.logging.log4j.core.util.DefaultShutdownCallbackRegistry DEBUG StatusLogger Took 0.063567 seconds to load 214 plugins from sun.misc.Launcher$AppClassLoader@677327b6 DEBUG StatusLogger PluginManager 'Converter' found 42 plugins DEBUG StatusLogger Starting OutputStreamManager SYSTEM_OUT.false.false-1 DEBUG StatusLogger Starting LoggerContext[name=677327b6, org.apache.logging.log4j.core.LoggerContext@56de5251]... DEBUG StatusLogger Reconfiguration started for context[name=677327b6] at URI null (org.apache.logging.log4j.core.LoggerContext@56de5251) with optional ClassLoader: null DEBUG StatusLogger PluginManager 'ConfigurationFactory' found 4 plugins DEBUG StatusLogger Missing dependencies for Yaml support, ConfigurationFactory org.apache.logging.log4j.core.config.yaml.YamlConfigurationFactory is inactive DEBUG StatusLogger Using configurationFactory org.apache.logging.log4j.core.config.ConfigurationFactory$Factory@794cb805 DEBUG StatusLogger Initializing configuration org.apache.logging.log4j.core.config.properties.PropertiesConfiguration@1622f1b DEBUG StatusLogger Installed 3 script engines DEBUG StatusLogger Groovy Scripting Engine version: 2.0, language: Groovy, threading: MULTITHREADED, compile: true, names: [groovy, Groovy], factory class: org.codehaus.groovy.jsr223.GroovyScriptEngineFactory DEBUG StatusLogger Scala Interpreter version: 1.0, language: Scala, threading: Not Thread Safe, compile: true, names: [scala], factory class: scala.tools.nsc.interpreter.IMain$Factory DEBUG StatusLogger Oracle Nashorn version: 1.8.0_191, language: ECMAScript, threading: Not Thread Safe, compile: true, names: [nashorn, Nashorn, js, JS, JavaScript, javascript, ECMAScript, ecmascript], factory class: jdk.nashorn.api.scripting.NashornScriptEngineFactory INFO StatusLogger Scanning for classes in '/work/hive21109/cr/ql/target/test-classes/org/apache/hadoop/hive/ql/log' matching criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.TestLog4j2Appenders matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.TestSlidingFilenameRolloverStrategy matches criteria annotated with @Plugin INFO StatusLogger Scanning for classes in '/work/hive21109/cr/ql/target/classes/org/apache/hadoop/hive/ql/log' matching criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.HiveEventCounter$1 matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.LogDivertAppender$NameFilter matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.NullAppender matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.HiveEventCounter$EventCounts matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.LogDivertAppenderForTest$TestFilter matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.HushableRandomAccessFileAppender matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.SlidingFilenameRolloverStrategy matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.LogDivertAppender matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.LogDivertAppenderForTest matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.HiveEventCounter matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.PidFilePatternConverter matches criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.SlidingFilenameRolloverStrategy$1 matches criteria annotated with @Plugin INFO StatusLogger Scanning for classes in '/home/abapat/.m2/repository/org/apache/hive/hive-common/4.0.0-SNAPSHOT/hive-common-4.0.0-SNAPSHOT.jar' matching criteria annotated with @Plugin DEBUG StatusLogger Checking to see if class org.apache.hadoop.hive.ql.log.PerfLogger matches criteria annotated with @Plugin DEBUG StatusLogger Took 0.024561 seconds to load 7 plugins from package org.apache.hadoop.hive.ql.log DEBUG StatusLogger PluginManager 'Core' found 125 plugins DEBUG StatusLogger PluginManager 'Level' found 0 plugins DEBUG StatusLogger Building Plugin[name=property, class=org.apache.logging.log4j.core.config.Property]. TRACE StatusLogger TypeConverterRegistry initializing. DEBUG StatusLogger PluginManager 'TypeConverter' found 26 plugins DEBUG StatusLogger createProperty(name="hive.log.file", value="hive.log") DEBUG StatusLogger Building Plugin[name=property, class=org.apache.logging.log4j.core.config.Property]. DEBUG StatusLogger createProperty(name="hive.log.dir", value="/work/hive21109/cr/ql/target/tmp/log") DEBUG StatusLogger Building Plugin[name=property, class=org.apache.logging.log4j.core.config.Property]. DEBUG StatusLogger createProperty(name="hive.root.logger", value="DRFA") DEBUG StatusLogger Building Plugin[name=property, class=org.apache.logging.log4j.core.config.Property]. DEBUG StatusLogger createProperty(name="hive.log.level", value="DEBUG") DEBUG StatusLogger Building Plugin[name=property, class=org.apache.logging.log4j.core.config.Property]. DEBUG StatusLogger createProperty(name="hive.test.console.log.level", value="INFO") DEBUG StatusLogger Building Plugin[name=properties, class=org.apache.logging.log4j.core.config.PropertiesPlugin]. DEBUG StatusLogger configureSubstitutor(={hive.log.file=hive.log, hive.log.dir=/work/hive21109/cr/ql/target/tmp/log, hive.root.logger=DRFA, hive.log.level=DEBUG, hive.test.console.log.level=INFO}, Configuration(HiveLog4j2Test)) DEBUG StatusLogger PluginManager 'Lookup' found 14 plugins DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.hadoop.ipc", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.hadoop.security", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.hadoop.hdfs", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.hadoop.hdfs.server", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.hadoop.metrics2", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.mortbay", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.hadoop.yarn", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.hadoop.yarn.server", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.tez", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="ERROR", name="org.apache.hadoop.conf.Configuration", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.zookeeper", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.zookeeper.server.ServerCnxn", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.zookeeper.server.NIOServerCnxn", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.zookeeper.ClientCnxn", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.zookeeper.ClientCnxnSocket", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.zookeeper.ClientCnxnSocketNIO", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="ERROR", name="DataNucleus", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="ERROR", name="Datastore", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="ERROR", name="JPOX", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.hadoop.hive.ql.exec.Operator", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.hadoop.hive.serde2.lazy", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.hadoop.hive.metastore.ObjectStore", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.calcite.plan.RelOptPlanner", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="com.amazonaws", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="INFO", name="org.apache.http", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.apache.thrift", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="org.eclipse.jetty", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=logger, class=org.apache.logging.log4j.core.config.LoggerConfig]. DEBUG StatusLogger createLogger(additivity="true", level="WARN", name="BlockStateChange", includeLocation="null", ={}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=AppenderRef, class=org.apache.logging.log4j.core.config.AppenderRef]. DEBUG StatusLogger createAppenderRef(ref="console", level="INFO", Filter=null) DEBUG StatusLogger Building Plugin[name=AppenderRef, class=org.apache.logging.log4j.core.config.AppenderRef]. DEBUG StatusLogger createAppenderRef(ref="DRFA", level="null", Filter=null) DEBUG StatusLogger Building Plugin[name=root, class=org.apache.logging.log4j.core.config.LoggerConfig$RootLogger]. DEBUG StatusLogger createLogger(additivity="null", level="DEBUG", includeLocation="null", ={console, DRFA}, ={}, Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Building Plugin[name=loggers, class=org.apache.logging.log4j.core.config.LoggersPlugin]. DEBUG StatusLogger createLoggers(={org.apache.hadoop.ipc, org.apache.hadoop.security, org.apache.hadoop.hdfs, org.apache.hadoop.hdfs.server, org.apache.hadoop.metrics2, org.mortbay, org.apache.hadoop.yarn, org.apache.hadoop.yarn.server, org.apache.tez, org.apache.hadoop.conf.Configuration, org.apache.zookeeper, org.apache.zookeeper.server.ServerCnxn, org.apache.zookeeper.server.NIOServerCnxn, org.apache.zookeeper.ClientCnxn, org.apache.zookeeper.ClientCnxnSocket, org.apache.zookeeper.ClientCnxnSocketNIO, DataNucleus, Datastore, JPOX, org.apache.hadoop.hive.ql.exec.Operator, org.apache.hadoop.hive.serde2.lazy, org.apache.hadoop.hive.metastore.ObjectStore, org.apache.calcite.plan.RelOptPlanner, com.amazonaws, org.apache.http, org.apache.thrift, org.eclipse.jetty, BlockStateChange, root}) DEBUG StatusLogger Building Plugin[name=layout, class=org.apache.logging.log4j.core.layout.PatternLayout]. DEBUG StatusLogger PatternLayout$Builder(pattern="%d{ISO8601} %5p [%t] %c{2}: %m%n", PatternSelector=null, Configuration(HiveLog4j2Test), Replace=null, charset="null", alwaysWriteExceptions="null", disableAnsi="null", noConsoleNoAnsi="null", header="null", footer="null") DEBUG StatusLogger PluginManager 'Converter' found 42 plugins DEBUG StatusLogger Building Plugin[name=appender, class=org.apache.logging.log4j.core.appender.ConsoleAppender]. DEBUG StatusLogger ConsoleAppender$Builder(target="SYSTEM_ERR", follow="null", direct="null", bufferedIo="null", bufferSize="null", immediateFlush="null", ignoreExceptions="null", PatternLayout(%d{ISO8601} %5p [%t] %c{2}: %m%n), name="console", Configuration(HiveLog4j2Test), Filter=null) DEBUG StatusLogger Starting OutputStreamManager SYSTEM_ERR.false.false DEBUG StatusLogger Building Plugin[name=layout, class=org.apache.logging.log4j.core.layout.PatternLayout]. DEBUG StatusLogger PatternLayout$Builder(pattern="%d{ISO8601} %5p [%t] %c{2}: %m%n", PatternSelector=null, Configuration(HiveLog4j2Test), Replace=null, charset="null", alwaysWriteExceptions="null", disableAnsi="null", noConsoleNoAnsi="null", header="null", footer="null") DEBUG StatusLogger Building Plugin[name=TimeBasedTriggeringPolicy, class=org.apache.logging.log4j.core.appender.rolling.TimeBasedTriggeringPolicy]. DEBUG StatusLogger TimeBasedTriggeringPolicy$Builder(interval="1", modulate="true", maxRandomDelay="null") DEBUG StatusLogger Building Plugin[name=Policies, class=org.apache.logging.log4j.core.appender.rolling.CompositeTriggeringPolicy]. DEBUG StatusLogger createPolicy(={TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)}) DEBUG StatusLogger Building Plugin[name=DefaultRolloverStrategy, class=org.apache.logging.log4j.core.appender.rolling.DefaultRolloverStrategy]. DEBUG StatusLogger DefaultRolloverStrategy$Builder(max="30", min="null", fileIndex="null", compressionLevel="null", ={}, stopCustomActionsOnError="null", tempCompressedFilePattern="null", Configuration(HiveLog4j2Test)) DEBUG StatusLogger Building Plugin[name=appender, class=org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender]. DEBUG StatusLogger RollingRandomAccessFileAppender$Builder(fileName="/work/hive21109/cr/ql/target/tmp/log/hive.log", filePattern="/work/hive21109/cr/ql/target/tmp/log/hive.log.%d{yyyy-MM-dd}", append="null", Policies(CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)])), DefaultRolloverStrategy(DefaultRolloverStrategy(min=1, max=30, useMax=true)), advertise="null", advertiseURI="null", filePermissions="null", fileOwner="null", fileGroup="null", bufferedIo="null", bufferSize="null", immediateFlush="null", ignoreExceptions="null", PatternLayout(%d{ISO8601} %5p [%t] %c{2}: %m%n), name="DRFA", Configuration(HiveLog4j2Test), Filter=null) TRACE StatusLogger RandomAccessFile /work/hive21109/cr/ql/target/tmp/log/hive.log seek to 0 DEBUG StatusLogger Starting RollingRandomAccessFileManager /work/hive21109/cr/ql/target/tmp/log/hive.log DEBUG StatusLogger PluginManager 'FileConverter' found 3 plugins DEBUG StatusLogger Setting prev file time to 2019-03-12T03:24:23.417-0700 DEBUG StatusLogger Initializing triggering policy CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]) TRACE StatusLogger PatternProcessor.getNextTime returning 2019/03/13-00:00:00.000, nextFileTime=2019/03/12-00:00:00.000, prevFileTime=1969/12/31-16:00:00.000, current=2019/03/12-03:24:23.427, freq=DAILY TRACE StatusLogger PatternProcessor.getNextTime returning 2019/03/13-00:00:00.000, nextFileTime=2019/03/12-00:00:00.000, prevFileTime=2019/03/12-00:00:00.000, current=2019/03/12-03:24:23.428, freq=DAILY DEBUG StatusLogger Building Plugin[name=appenders, class=org.apache.logging.log4j.core.config.AppendersPlugin]. DEBUG StatusLogger createAppenders(={console, DRFA}) DEBUG StatusLogger Configuration org.apache.logging.log4j.core.config.properties.PropertiesConfiguration@1622f1b initialized DEBUG StatusLogger Starting configuration org.apache.logging.log4j.core.config.properties.PropertiesConfiguration@1622f1b DEBUG StatusLogger Started configuration org.apache.logging.log4j.core.config.properties.PropertiesConfiguration@1622f1b OK. TRACE StatusLogger Stopping org.apache.logging.log4j.core.config.DefaultConfiguration@a74868d... TRACE StatusLogger DefaultConfiguration notified 1 ReliabilityStrategies that config will be stopped. TRACE StatusLogger DefaultConfiguration stopping root LoggerConfig. TRACE StatusLogger DefaultConfiguration notifying ReliabilityStrategies that appenders will be stopped. TRACE StatusLogger DefaultConfiguration stopping remaining Appenders. DEBUG StatusLogger Shutting down OutputStreamManager SYSTEM_OUT.false.false-1 DEBUG StatusLogger Shut down OutputStreamManager SYSTEM_OUT.false.false-1, all resources released: true DEBUG StatusLogger Appender DefaultConsole-1 stopped with status true TRACE StatusLogger DefaultConfiguration stopped 1 remaining Appenders. TRACE StatusLogger DefaultConfiguration cleaning Appenders from 1 LoggerConfigs. DEBUG StatusLogger Stopped org.apache.logging.log4j.core.config.DefaultConfiguration@a74868d OK TRACE StatusLogger Reregistering MBeans after reconfigure. Selector=org.apache.logging.log4j.core.selector.ClassLoaderContextSelector@285f09de TRACE StatusLogger Reregistering context (1/1): '677327b6' org.apache.logging.log4j.core.LoggerContext@56de5251 TRACE StatusLogger Unregistering but no MBeans found matching 'org.apache.logging.log4j2:type=677327b6' TRACE StatusLogger Unregistering but no MBeans found matching 'org.apache.logging.log4j2:type=677327b6,component=StatusLogger' TRACE StatusLogger Unregistering but no MBeans found matching 'org.apache.logging.log4j2:type=677327b6,component=ContextSelector' TRACE StatusLogger Unregistering but no MBeans found matching 'org.apache.logging.log4j2:type=677327b6,component=Loggers,name=*' TRACE StatusLogger Unregistering but no MBeans found matching 'org.apache.logging.log4j2:type=677327b6,component=Appenders,name=*' TRACE StatusLogger Unregistering but no MBeans found matching 'org.apache.logging.log4j2:type=677327b6,component=AsyncAppenders,name=*' TRACE StatusLogger Unregistering but no MBeans found matching 'org.apache.logging.log4j2:type=677327b6,component=AsyncLoggerRingBuffer' TRACE StatusLogger Unregistering but no MBeans found matching 'org.apache.logging.log4j2:type=677327b6,component=Loggers,name=*,subtype=RingBuffer' DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6 DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=StatusLogger DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=ContextSelector DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name= DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.tez DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=com.amazonaws DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.thrift DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.eclipse.jetty DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=BlockStateChange DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.metrics2 DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.zookeeper.ClientCnxn DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.zookeeper DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.security DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=JPOX DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.yarn.server DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.conf.Configuration DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.yarn DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.zookeeper.ClientCnxnSocketNIO DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.zookeeper.server.ServerCnxn DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.hdfs DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.hdfs.server DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.hive.serde2.lazy DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.zookeeper.ClientCnxnSocket DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.mortbay DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.http DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.hive.ql.exec.Operator DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=DataNucleus DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=Datastore DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.hive.metastore.ObjectStore DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.hadoop.ipc DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.zookeeper.server.NIOServerCnxn DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Loggers,name=org.apache.calcite.plan.RelOptPlanner DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Appenders,name=console DEBUG StatusLogger Registering MBean org.apache.logging.log4j2:type=677327b6,component=Appenders,name=DRFA TRACE StatusLogger Using default SystemClock for timestamps. TRACE StatusLogger Using DummyNanoClock for nanosecond timestamps. DEBUG StatusLogger Reconfiguration complete for context[name=677327b6] at URI /work/hive21109/cr/ql/target/testconf/hive-log4j2.properties (org.apache.logging.log4j.core.LoggerContext@56de5251) with optional ClassLoader: null DEBUG StatusLogger Shutdown hook enabled. Registering a new one. DEBUG StatusLogger LoggerContext[name=677327b6, org.apache.logging.log4j.core.LoggerContext@56de5251] started OK. 2019-03-12T03:24:23,510 INFO [main] conf.HiveConf: Found configuration file file:/work/hive21109/cr/ql/target/testconf/hive-site.xml DEBUG StatusLogger AsyncLogger.ThreadNameStrategy=UNCACHED (user specified null, default is UNCACHED) TRACE StatusLogger Using default SystemClock for timestamps. 2019-03-12T03:24:23,942 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2019-03-12T03:24:24,032 WARN [main] conf.HiveConf: HiveConf of name hive.llap.io.cache.orc.size does not exist 2019-03-12T03:24:24,032 WARN [main] conf.HiveConf: HiveConf of name hive.dummyparam.test.server.specific.config.override does not exist 2019-03-12T03:24:24,032 WARN [main] conf.HiveConf: HiveConf of name hive.metastore.metadb.dir does not exist 2019-03-12T03:24:24,033 WARN [main] conf.HiveConf: HiveConf of name hive.llap.io.cache.orc.alloc.min does not exist 2019-03-12T03:24:24,033 WARN [main] conf.HiveConf: HiveConf of name hive.dummyparam.test.server.specific.config.hivesite does not exist 2019-03-12T03:24:24,033 WARN [main] conf.HiveConf: HiveConf of name hive.llap.io.cache.orc.alloc.max does not exist 2019-03-12T03:24:24,034 WARN [main] conf.HiveConf: HiveConf of name hive.dummyparam.test.server.specific.config.metastoresite does not exist 2019-03-12T03:24:24,034 WARN [main] conf.HiveConf: HiveConf of name hive.llap.io.cache.orc.arena.size does not exist 2019-03-12T03:24:24,035 WARN [main] conf.HiveConf: HiveConf of name hive.stats.key.prefix.reserve.length does not exist Hive Session ID = 8e4d0a46-87b7-464c-9273-80437a13d4e9 2019-03-12T03:24:24,944 INFO [main] SessionState: Hive Session ID = 8e4d0a46-87b7-464c-9273-80437a13d4e9 ivysettings.xml file not found in HIVE_HOME or HIVE_CONF_DIR,/work/hive21109/cr/conf/ivysettings.xml will be used 2019-03-12T03:24:24,973 INFO [main] DependencyResolver: ivysettings.xml file not found in HIVE_HOME or HIVE_CONF_DIR,/work/hive21109/cr/conf/ivysettings.xml will be used 2019-03-12T03:24:25,489 INFO [main] session.SessionState: Created HDFS directory: /work/hive21109/cr/ql/target/tmp/scratchdir/abapat 2019-03-12T03:24:25,492 INFO [main] session.SessionState: Created local directory: /work/hive21109/cr/ql/target/tmp/localscratchdir 2019-03-12T03:24:25,496 INFO [main] session.SessionState: Created HDFS directory: /work/hive21109/cr/ql/target/tmp/scratchdir/abapat/8e4d0a46-87b7-464c-9273-80437a13d4e9 2019-03-12T03:24:25,500 INFO [main] session.SessionState: Created local directory: /work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9 2019-03-12T03:24:25,504 INFO [main] session.SessionState: Created HDFS directory: /work/hive21109/cr/ql/target/tmp/scratchdir/abapat/8e4d0a46-87b7-464c-9273-80437a13d4e9/_tmp_space.db 2019-03-12T03:24:25,553 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032425_f64e4730-d792-4147-8e28-70b4b30eb66e): drop table simple_stats 2019-03-12T03:24:27,008 INFO [main] metastore.HiveMetaStoreClient: HMS client filtering is enabled. 2019-03-12T03:24:27,345 INFO [main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore 2019-03-12T03:24:27,384 WARN [main] metastore.PersistenceManagerProvider: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored 2019-03-12T03:24:27,386 INFO [main] metastore.PersistenceManagerProvider: Updating the pmf due to property change 2019-03-12T03:24:27,387 INFO [main] metastore.PersistenceManagerProvider: Current pmf properties are uninitialized 2019-03-12T03:24:27,427 INFO [main] hikari.HikariDataSource: HikariPool-1 - Starting... 2019-03-12T03:24:27,455 INFO [main] pool.PoolBase: HikariPool-1 - Driver does not support get/set network timeout for connections. (Feature not implemented: No details.) 2019-03-12T03:24:27,463 INFO [main] hikari.HikariDataSource: HikariPool-1 - Start completed. 2019-03-12T03:24:28,165 INFO [main] metastore.PersistenceManagerProvider: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" 2019-03-12T03:24:28,165 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@6568f998, with PersistenceManager: null will be shutdown 2019-03-12T03:24:28,187 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@6568f998, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@63917fe1 created in the thread with id: 1 2019-03-12T03:24:31,244 WARN [main] metastore.ObjectStore: Version information not found in metastore. metastore.schema.verification is not enabled so recording the schema version 4.0.0 2019-03-12T03:24:31,244 WARN [main] metastore.ObjectStore: setMetaStoreSchemaVersion called but recording version is disabled: version = 4.0.0, comment = Set by MetaStore abapat@127.0.1.1 2019-03-12T03:24:31,244 INFO [main] metastore.HiveMetaStore: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@6568f998 from thread id: 1 2019-03-12T03:24:31,335 WARN [main] metastore.ObjectStore: Failed to get database hive.default, returning NoSuchObjectException 2019-03-12T03:24:31,402 INFO [main] metastore.HiveMetaStore: Added admin role in metastore 2019-03-12T03:24:31,404 INFO [main] metastore.HiveMetaStore: Added public role in metastore 2019-03-12T03:24:31,528 INFO [main] metastore.HiveMetaStore: Added hive_admin_user to admin role 2019-03-12T03:24:31,552 INFO [main] metastore.HiveMetaStore: HMS server filtering is disabled by configuration 2019-03-12T03:24:31,658 INFO [main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=abapat (auth:SIMPLE) retries=1 delay=1 lifetime=0 2019-03-12T03:24:31,679 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_all_functions 2019-03-12T03:24:31,784 INFO [main] txn.TxnHandler: Hacking in canned values for transaction manager 2019-03-12T03:24:31,791 INFO [main] txn.TxnDbUtil: Txn tables already exist, returning 2019-03-12T03:24:31,795 INFO [main] hikari.HikariDataSource: HikariPool-2 - Starting... 2019-03-12T03:24:31,799 INFO [main] pool.PoolBase: HikariPool-2 - Driver does not support get/set network timeout for connections. (Feature not implemented: No details.) 2019-03-12T03:24:31,800 INFO [main] hikari.HikariDataSource: HikariPool-2 - Start completed. 2019-03-12T03:24:31,804 INFO [main] hikari.HikariDataSource: HikariPool-3 - Starting... 2019-03-12T03:24:31,806 INFO [main] pool.PoolBase: HikariPool-3 - Driver does not support get/set network timeout for connections. (Feature not implemented: No details.) 2019-03-12T03:24:31,807 INFO [main] hikari.HikariDataSource: HikariPool-3 - Start completed. 2019-03-12T03:24:31,831 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([1]) with min_open_txn: 1 2019-03-12T03:24:31,848 INFO [main] lockmgr.DbTxnManager: Opened txnid:1 2019-03-12T03:24:31,864 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:31,887 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:31,890 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2019-03-12T03:24:31,893 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:31,893 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032425_f64e4730-d792-4147-8e28-70b4b30eb66e); Time taken: 6.365 seconds 2019-03-12T03:24:31,895 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:1 for queryId=abapat_20190312032425_f64e4730-d792-4147-8e28-70b4b30eb66e 2019-03-12T03:24:31,895 INFO [main] ql.Driver: Operation DROPTABLE obtained 0 locks 2019-03-12T03:24:31,897 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032425_f64e4730-d792-4147-8e28-70b4b30eb66e): drop table simple_stats 2019-03-12T03:24:31,913 INFO [main] ql.Driver: Starting task [Stage-0:DDL] in serial mode 2019-03-12T03:24:31,915 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:31,941 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:31,944 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase 2019-03-12T03:24:31,944 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032425_f64e4730-d792-4147-8e28-70b4b30eb66e); Time taken: 0.047 seconds 2019-03-12T03:24:31,944 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032425_f64e4730-d792-4147-8e28-70b4b30eb66e 2019-03-12T03:24:31,956 INFO [main] txn.TxnHandler: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:1 2019-03-12T03:24:31,973 INFO [main] txn.TxnHandler: Removed committed transaction: (1) from MIN_HISTORY_LEVEL 2019-03-12T03:24:31,979 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032431_e7b056c0-2b02-4779-a89e-a92e76c521ca): drop table simple_stats2 2019-03-12T03:24:31,992 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([2]) with min_open_txn: 2 2019-03-12T03:24:31,993 INFO [main] lockmgr.DbTxnManager: Opened txnid:2 2019-03-12T03:24:31,998 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats2 2019-03-12T03:24:32,000 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:32,000 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2019-03-12T03:24:32,001 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:32,001 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032431_e7b056c0-2b02-4779-a89e-a92e76c521ca); Time taken: 0.021 seconds 2019-03-12T03:24:32,001 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:2 for queryId=abapat_20190312032431_e7b056c0-2b02-4779-a89e-a92e76c521ca 2019-03-12T03:24:32,001 INFO [main] ql.Driver: Operation DROPTABLE obtained 0 locks 2019-03-12T03:24:32,003 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032431_e7b056c0-2b02-4779-a89e-a92e76c521ca): drop table simple_stats2 2019-03-12T03:24:32,003 INFO [main] ql.Driver: Starting task [Stage-0:DDL] in serial mode 2019-03-12T03:24:32,004 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats2 2019-03-12T03:24:32,005 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats2 2019-03-12T03:24:32,007 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase 2019-03-12T03:24:32,007 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032431_e7b056c0-2b02-4779-a89e-a92e76c521ca); Time taken: 0.004 seconds 2019-03-12T03:24:32,007 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032431_e7b056c0-2b02-4779-a89e-a92e76c521ca 2019-03-12T03:24:32,019 INFO [main] txn.TxnHandler: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:2 2019-03-12T03:24:32,029 INFO [main] txn.TxnHandler: Removed committed transaction: (2) from MIN_HISTORY_LEVEL 2019-03-12T03:24:32,033 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032432_98728ad2-fd6d-405a-b1cc-336173f97e1a): drop table simple_stats3 2019-03-12T03:24:32,045 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([3]) with min_open_txn: 3 2019-03-12T03:24:32,045 INFO [main] lockmgr.DbTxnManager: Opened txnid:3 2019-03-12T03:24:32,052 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats3 2019-03-12T03:24:32,054 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:32,054 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2019-03-12T03:24:32,054 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:32,055 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032432_98728ad2-fd6d-405a-b1cc-336173f97e1a); Time taken: 0.021 seconds 2019-03-12T03:24:32,055 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:3 for queryId=abapat_20190312032432_98728ad2-fd6d-405a-b1cc-336173f97e1a 2019-03-12T03:24:32,055 INFO [main] ql.Driver: Operation DROPTABLE obtained 0 locks 2019-03-12T03:24:32,058 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032432_98728ad2-fd6d-405a-b1cc-336173f97e1a): drop table simple_stats3 2019-03-12T03:24:32,058 INFO [main] ql.Driver: Starting task [Stage-0:DDL] in serial mode 2019-03-12T03:24:32,059 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats3 2019-03-12T03:24:32,061 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats3 2019-03-12T03:24:32,063 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase 2019-03-12T03:24:32,063 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032432_98728ad2-fd6d-405a-b1cc-336173f97e1a); Time taken: 0.005 seconds 2019-03-12T03:24:32,063 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032432_98728ad2-fd6d-405a-b1cc-336173f97e1a 2019-03-12T03:24:32,072 INFO [main] txn.TxnHandler: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:3 2019-03-12T03:24:32,084 INFO [main] txn.TxnHandler: Removed committed transaction: (3) from MIN_HISTORY_LEVEL 2019-03-12T03:24:32,092 INFO [main] txn.TxnHandler: Hacking in canned values for transaction manager 2019-03-12T03:24:32,096 INFO [main] txn.TxnDbUtil: Txn tables already exist, returning 2019-03-12T03:24:32,096 WARN [main] metastore.PersistenceManagerProvider: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored 2019-03-12T03:24:32,097 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@5c2a3f0c, with PersistenceManager: null will be shutdown 2019-03-12T03:24:32,098 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@5c2a3f0c, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@6585df70 created in the thread with id: 1 2019-03-12T03:24:32,212 WARN [main] conf.HiveConf: HiveConf of name hive.llap.io.cache.orc.size does not exist 2019-03-12T03:24:32,212 WARN [main] conf.HiveConf: HiveConf of name hive.dummyparam.test.server.specific.config.override does not exist 2019-03-12T03:24:32,212 WARN [main] conf.HiveConf: HiveConf of name hive.metastore.metadb.dir does not exist 2019-03-12T03:24:32,212 WARN [main] conf.HiveConf: HiveConf of name hive.llap.io.cache.orc.alloc.min does not exist 2019-03-12T03:24:32,212 WARN [main] conf.HiveConf: HiveConf of name hive.dummyparam.test.server.specific.config.hivesite does not exist 2019-03-12T03:24:32,212 WARN [main] conf.HiveConf: HiveConf of name hive.llap.io.cache.orc.alloc.max does not exist 2019-03-12T03:24:32,213 WARN [main] conf.HiveConf: HiveConf of name hive.dummyparam.test.server.specific.config.metastoresite does not exist 2019-03-12T03:24:32,213 WARN [main] conf.HiveConf: HiveConf of name hive.llap.io.cache.orc.arena.size does not exist 2019-03-12T03:24:32,213 WARN [main] conf.HiveConf: HiveConf of name hive.stats.key.prefix.reserve.length does not exist 2019-03-12T03:24:32,214 INFO [main] metastore.HiveMetaStoreClient: HMS client filtering is enabled. 2019-03-12T03:24:32,215 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@6568f998, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@63917fe1 will be shutdown 2019-03-12T03:24:32,216 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@6568f998, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@77a85e76 created in the thread with id: 1 2019-03-12T03:24:32,221 INFO [main] metastore.HiveMetaStore: HMS server filtering is disabled by configuration 2019-03-12T03:24:32,222 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8): create table simple_stats (s string) partitioned by (i int) stored as orc TBLPROPERTIES ("transactional"="true") 2019-03-12T03:24:32,264 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([4]) with min_open_txn: 4 2019-03-12T03:24:32,264 INFO [main] lockmgr.DbTxnManager: Opened txnid:4 2019-03-12T03:24:32,277 INFO [main] parse.CalcitePlanner: Starting Semantic Analysis 2019-03-12T03:24:32,307 INFO [main] sqlstd.SQLStdHiveAccessController: Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=8e4d0a46-87b7-464c-9273-80437a13d4e9, clientType=HIVESERVER2] 2019-03-12T03:24:32,309 INFO [main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook 2019-03-12T03:24:32,311 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=Cleaning up thread local RawStore... 2019-03-12T03:24:32,311 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@6568f998, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@77a85e76 will be shutdown 2019-03-12T03:24:32,311 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore 2019-03-12T03:24:32,313 INFO [main] metastore.HiveMetaStoreClient: HMS client filtering is enabled. 2019-03-12T03:24:32,314 INFO [main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore 2019-03-12T03:24:32,314 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3dd66ff5, with PersistenceManager: null will be shutdown 2019-03-12T03:24:32,315 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3dd66ff5, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@24258b54 created in the thread with id: 1 2019-03-12T03:24:32,319 INFO [main] metastore.HiveMetaStore: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3dd66ff5 from thread id: 1 2019-03-12T03:24:32,319 INFO [main] metastore.HiveMetaStore: HMS server filtering is disabled by configuration 2019-03-12T03:24:32,320 INFO [main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=abapat (auth:SIMPLE) retries=1 delay=1 lifetime=0 2019-03-12T03:24:32,327 INFO [main] parse.CalcitePlanner: Creating table default.simple_stats position=13 2019-03-12T03:24:32,343 INFO [main] metastore.HiveMetaStoreClient: HMS client filtering is enabled. 2019-03-12T03:24:32,344 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3dd66ff5, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@24258b54 will be shutdown 2019-03-12T03:24:32,344 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3dd66ff5, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@d677be9 created in the thread with id: 1 2019-03-12T03:24:32,350 INFO [main] metastore.HiveMetaStore: HMS server filtering is disabled by configuration 2019-03-12T03:24:32,350 INFO [main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=abapat (auth:SIMPLE) retries=1 delay=1 lifetime=0 2019-03-12T03:24:32,350 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_database: @hive#default 2019-03-12T03:24:32,385 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:32,390 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2019-03-12T03:24:32,390 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:32,392 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8); Time taken: 0.168 seconds 2019-03-12T03:24:32,392 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:4 for queryId=abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8 2019-03-12T03:24:32,396 INFO [main] lockmgr.DbLockManager: Requesting: queryId=abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8 LockRequest(component:[LockComponent(type:SHARED_READ, level:DB, dbname:default, operationType:NO_TXN, isDynamicPartitionWrite:false)], txnid:4, user:abapat, hostname:ubuntu, agentInfo:abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8) 2019-03-12T03:24:32,430 INFO [main] lockmgr.DbLockManager: Response to queryId=abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8 LockResponse(lockid:1, state:ACQUIRED) 2019-03-12T03:24:32,430 INFO [main] ql.Driver: Operation CREATETABLE obtained 1 locks 2019-03-12T03:24:32,448 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8): create table simple_stats (s string) partitioned by (i int) stored as orc TBLPROPERTIES ("transactional"="true") 2019-03-12T03:24:32,449 INFO [main] ql.Driver: Starting task [Stage-0:DDL] in serial mode 2019-03-12T03:24:32,471 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=create_table: Table(tableName:simple_stats, dbName:default, owner:abapat, createTime:1552386272, lastAccessTime:0, retention:0, sd:StorageDescriptor(cols:[FieldSchema(name:s, type:string, comment:null)], location:null, inputFormat:org.apache.hadoop.hive.ql.io.orc.OrcInputFormat, outputFormat:org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat, compressed:false, numBuckets:-1, serdeInfo:SerDeInfo(name:null, serializationLib:org.apache.hadoop.hive.ql.io.orc.OrcSerde, parameters:{serialization.format=1}), bucketCols:[], sortCols:[], parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], skewedColValueLocationMaps:{}), storedAsSubDirectories:false), partitionKeys:[FieldSchema(name:i, type:int, comment:null)], parameters:{bucketing_version=2, transactional=true}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE, privileges:PrincipalPrivilegeSet(userPrivileges:{abapat=[PrivilegeGrantInfo(privilege:INSERT, createTime:-1, grantor:abapat, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:SELECT, createTime:-1, grantor:abapat, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:UPDATE, createTime:-1, grantor:abapat, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:DELETE, createTime:-1, grantor:abapat, grantorType:USER, grantOption:true)]}, groupPrivileges:null, rolePrivileges:null), temporary:false, catName:hive, ownerType:USER, writeId:0) 2019-03-12T03:24:32,478 INFO [main] utils.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats 2019-03-12T03:24:32,661 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase 2019-03-12T03:24:32,662 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8); Time taken: 0.213 seconds 2019-03-12T03:24:32,662 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032432_aabc756a-8b3f-428c-afbe-9e1afcadf3e8 2019-03-12T03:24:32,668 INFO [main] txn.TxnHandler: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:4 2019-03-12T03:24:32,679 INFO [main] txn.TxnHandler: Removed committed transaction: (4) from MIN_HISTORY_LEVEL 2019-03-12T03:24:32,685 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb): insert into simple_stats (i, s) values (1, 'test') 2019-03-12T03:24:32,699 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([5]) with min_open_txn: 5 2019-03-12T03:24:32,699 INFO [main] lockmgr.DbTxnManager: Opened txnid:5 2019-03-12T03:24:32,703 INFO [main] parse.CalcitePlanner: Starting Semantic Analysis 2019-03-12T03:24:32,707 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:32,818 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:32,831 INFO [main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis 2019-03-12T03:24:32,831 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:32,831 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:32,831 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:32,832 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:32,845 INFO [main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis 2019-03-12T03:24:33,010 INFO [Finalizer] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore 2019-03-12T03:24:33,578 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:33,596 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:33,613 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:33,614 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:33,624 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=_dummy_database foreigntbl=_dummy_table 2019-03-12T03:24:34,192 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_databases: @hive# 2019-03-12T03:24:34,202 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_materialized_views_for_rewriting: db=@hive#default 2019-03-12T03:24:34,258 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:34,269 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:34,269 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:34,269 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:34,269 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:34,271 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:34,271 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:34,274 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:34,274 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:34,322 INFO [main] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1 2019-03-12T03:24:34,326 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.simple_stats 2019-03-12T03:24:34,328 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_check_constraints : tbl=hive.default.simple_stats 2019-03-12T03:24:34,360 INFO [main] txn.TxnHandler: Allocated writeID: 1 for txnId: 5 2019-03-12T03:24:34,375 INFO [main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan. 2019-03-12T03:24:34,424 INFO [main] ppd.OpProcFactory: Processing for FS(4) 2019-03-12T03:24:34,425 INFO [main] ppd.OpProcFactory: Processing for SEL(3) 2019-03-12T03:24:34,425 INFO [main] ppd.OpProcFactory: Processing for UDTF(2) 2019-03-12T03:24:34,425 INFO [main] ppd.OpProcFactory: Processing for SEL(1) 2019-03-12T03:24:34,425 INFO [main] ppd.OpProcFactory: Processing for TS(0) 2019-03-12T03:24:34,461 INFO [main] correlation.AbstractCorrelationProcCtx: Overriding hive.optimize.reducededuplication.min.reducer to 1 due to a write to transactional table(s) default.simple_stats 2019-03-12T03:24:34,562 INFO [main] physical.Vectorizer: Examining input format to see if vectorization is enabled. 2019-03-12T03:24:34,571 INFO [main] physical.Vectorizer: Map vectorization enabled: false 2019-03-12T03:24:34,571 INFO [main] physical.Vectorizer: Map vectorized: false 2019-03-12T03:24:34,571 INFO [main] physical.Vectorizer: Map vectorizedVertexNum: 0 2019-03-12T03:24:34,572 INFO [main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vectorized.input.format IS true] 2019-03-12T03:24:34,572 INFO [main] physical.Vectorizer: Map enabledConditionsNotMet: [Could not enable vectorization due to partition column names size 1 is greater than the number of table column names size 0 IS false] 2019-03-12T03:24:34,572 INFO [main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.hive.ql.io.NullRowsInputFormat] 2019-03-12T03:24:34,576 INFO [main] parse.CalcitePlanner: Completed plan generation 2019-03-12T03:24:34,576 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:34,576 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:string, comment:null), FieldSchema(name:_col1, type:int, comment:null)], properties:null) 2019-03-12T03:24:34,577 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:34,577 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb); Time taken: 1.892 seconds 2019-03-12T03:24:34,577 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:5 for queryId=abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb 2019-03-12T03:24:34,578 INFO [main] lockmgr.DbLockManager: Requesting: queryId=abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb LockRequest(component:[LockComponent(type:SHARED_READ, level:TABLE, dbname:_dummy_database, tablename:_dummy_table, operationType:SELECT, isTransactional:false), LockComponent(type:SHARED_READ, level:TABLE, dbname:default, tablename:simple_stats, operationType:INSERT, isTransactional:true, isDynamicPartitionWrite:true)], txnid:5, user:abapat, hostname:ubuntu, agentInfo:abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb) 2019-03-12T03:24:34,599 INFO [main] lockmgr.DbLockManager: Response to queryId=abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb LockResponse(lockid:2, state:ACQUIRED) 2019-03-12T03:24:34,600 INFO [main] ql.Driver: Operation QUERY obtained 1 locks 2019-03-12T03:24:34,608 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb): insert into simple_stats (i, s) values (1, 'test') 2019-03-12T03:24:34,609 WARN [main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. Query ID = abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb 2019-03-12T03:24:34,609 INFO [main] ql.Driver: Query ID = abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb Total jobs = 1 2019-03-12T03:24:34,609 INFO [main] ql.Driver: Total jobs = 1 Launching Job 1 out of 1 2019-03-12T03:24:34,621 INFO [main] ql.Driver: Launching Job 1 out of 1 2019-03-12T03:24:34,637 INFO [main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode Number of reduce tasks is set to 0 since there's no reduce operator 2019-03-12T03:24:34,637 INFO [main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator 2019-03-12T03:24:34,647 INFO [main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.HiveInputFormat 2019-03-12T03:24:34,651 INFO [main] exec.Utilities: Processing alias $hdt$_0:_dummy_table 2019-03-12T03:24:34,651 INFO [main] exec.Utilities: Adding 1 inputs; the first input is file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-32_685_2442717654601358023-1/dummy_path 2019-03-12T03:24:34,744 INFO [main] exec.SerializationUtilities: Serializing MapWork using kryo 2019-03-12T03:24:34,762 INFO [main] exec.Utilities: Serialized plan (via FILE) - name: null size: 5.40KB 2019-03-12T03:24:34,903 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2019-03-12T03:24:34,920 WARN [main] impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-jobtracker.properties,hadoop-metrics2.properties 2019-03-12T03:24:34,934 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2019-03-12T03:24:34,934 INFO [main] impl.MetricsSystemImpl: JobTracker metrics system started 2019-03-12T03:24:34,955 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:35,027 WARN [main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2019-03-12T03:24:35,036 WARN [main] mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2019-03-12T03:24:35,044 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.ids = 2019-03-12T03:24:35,044 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.names = 2019-03-12T03:24:35,044 INFO [main] io.HiveInputFormat: Generating splits for dirs: file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-32_685_2442717654601358023-1/dummy_path 2019-03-12T03:24:35,045 INFO [main] io.NullRowsInputFormat$NullRowsRecordReader: Using null rows input format 2019-03-12T03:24:35,048 INFO [main] io.HiveInputFormat: number of splits 1 2019-03-12T03:24:35,081 INFO [main] mapreduce.JobSubmitter: number of splits:1 2019-03-12T03:24:35,179 INFO [main] mapreduce.JobSubmitter: Submitting tokens for job: job_local1064872213_0001 2019-03-12T03:24:35,180 INFO [main] mapreduce.JobSubmitter: Executing with tokens: [] 2019-03-12T03:24:35,398 INFO [main] mapreduce.Job: The url to track the job: http://localhost:8080/ Job running in-process (local Hadoop) 2019-03-12T03:24:35,400 INFO [main] exec.Task: Job running in-process (local Hadoop) 2019-03-12T03:24:35,401 INFO [Thread-84] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:35,402 INFO [Thread-84] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:35,416 INFO [Thread-84] mapred.LocalJobRunner: Waiting for map tasks 2019-03-12T03:24:35,421 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local1064872213_0001_m_000000_0 2019-03-12T03:24:35,468 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2019-03-12T03:24:35,478 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: org.apache.hadoop.hive.ql.io.NullRowsInputFormat:file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-32_685_2442717654601358023-1/dummy_path/null:0+1 2019-03-12T03:24:35,486 INFO [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:35,536 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.40KB 2019-03-12T03:24:35,543 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 0 2019-03-12T03:24:35,551 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: conf classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:35,551 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: thread classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:35,553 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Initializing Operator: MAP[0] 2019-03-12T03:24:35,554 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: Id =0 null <\Children> <\Parent> <\MAP> 2019-03-12T03:24:35,557 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing Operator: TS[0] 2019-03-12T03:24:35,558 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[1] 2019-03-12T03:24:35,562 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT null 2019-03-12T03:24:35,563 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: Initializing Operator: UDTF[2] 2019-03-12T03:24:35,564 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[3] 2019-03-12T03:24:35,564 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT struct 2019-03-12T03:24:35,564 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Initializing Operator: FS[4] 2019-03-12T03:24:35,565 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.ql.io.orc.OrcSerde@7940f859 and formatter : org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat@3cae476c 2019-03-12T03:24:35,571 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Final Path: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/_tmp.-ext-10000/i=1/000000_0 2019-03-12T03:24:35,571 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Writing to temp file: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/_task_tmp.-ext-10000/i=1/_tmp.000000_0 2019-03-12T03:24:35,571 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: New Final Path: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/_tmp.-ext-10000/i=1/000000_0 2019-03-12T03:24:35,595 INFO [LocalJobRunner Map Task Executor #0] impl.MemoryManagerImpl: orc.rows.between.memory.checks=5000 2019-03-12T03:24:35,609 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1 2019-03-12T03:24:35,635 INFO [LocalJobRunner Map Task Executor #0] impl.PhysicalFsWriter: ORC writer created for path: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/_task_tmp.-ext-10000/i=1/_tmp.000000_0/delta_0000001_0000001_0000/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768 2019-03-12T03:24:35,647 INFO [LocalJobRunner Map Task Executor #0] impl.OrcCodecPool: Got brand-new codec ZLIB 2019-03-12T03:24:35,677 INFO [LocalJobRunner Map Task Executor #0] impl.WriterImpl: ORC writer created for path: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/_task_tmp.-ext-10000/i=1/_tmp.000000_0/delta_0000001_0000001_0000/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768 2019-03-12T03:24:35,687 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: records read - 1 2019-03-12T03:24:35,687 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Closing Operator: MAP[0] 2019-03-12T03:24:35,687 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: Total records read - 3. abort - false 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:3, RECORDS_OUT_OPERATOR_MAP_0:0, 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Closing Operator: TS[0] 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:1, 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[1] 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_SEL_1:1, 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: Closing Operator: UDTF[2] 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: RECORDS_OUT_OPERATOR_UDTF_2:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[3] 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_OPERATOR_SEL_3:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Closing Operator: FS[4] 2019-03-12T03:24:35,688 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1 2019-03-12T03:24:35,719 INFO [LocalJobRunner Map Task Executor #0] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/_tmp.-ext-10000/i=1 2019-03-12T03:24:35,721 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: RECORDS_OUT_1_default.simple_stats:1, RECORDS_OUT_OPERATOR_FS_4:1, RECORDS_OUT_INTERMEDIATE:0, TOTAL_TABLE_ROWS_WRITTEN:1, 2019-03-12T03:24:35,724 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2019-03-12T03:24:35,731 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local1064872213_0001_m_000000_0 is done. And is in the process of committing 2019-03-12T03:24:35,732 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: map 2019-03-12T03:24:35,732 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local1064872213_0001_m_000000_0' done. 2019-03-12T03:24:35,734 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1064872213_0001_m_000000_0: Counters: 28 File System Counters FILE: Number of bytes read=5852 FILE: Number of bytes written=1113996 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Map input records=4 Map output records=0 Input split bytes=351 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=0 Total committed heap usage (bytes)=694681600 HIVE CREATED_DYNAMIC_PARTITIONS=1 CREATED_FILES=1 DESERIALIZE_ERRORS=0 RECORDS_IN=3 RECORDS_OUT_1_default.simple_stats=1 RECORDS_OUT_INTERMEDIATE=0 RECORDS_OUT_OPERATOR_FS_4=1 RECORDS_OUT_OPERATOR_MAP_0=0 RECORDS_OUT_OPERATOR_SEL_1=1 RECORDS_OUT_OPERATOR_SEL_3=1 RECORDS_OUT_OPERATOR_TS_0=1 RECORDS_OUT_OPERATOR_UDTF_2=1 TOTAL_TABLE_ROWS_WRITTEN=1 File Input Format Counters Bytes Read=5457 File Output Format Counters Bytes Written=0 2019-03-12T03:24:35,735 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local1064872213_0001_m_000000_0 2019-03-12T03:24:35,737 INFO [Thread-84] mapred.LocalJobRunner: map task executor complete. 2019-03-12 03:24:36,422 Stage-1 map = 100%, reduce = 0% 2019-03-12T03:24:36,422 INFO [main] exec.Task: 2019-03-12 03:24:36,422 Stage-1 map = 100%, reduce = 0% Ended Job = job_local1064872213_0001 2019-03-12T03:24:36,428 INFO [main] exec.Task: Ended Job = job_local1064872213_0001 2019-03-12T03:24:36,468 INFO [main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode Loading data to table default.simple_stats partition (i=null) 2019-03-12T03:24:36,468 INFO [main] exec.Task: Loading data to table default.simple_stats partition (i=null) from file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/-ext-10000 2019-03-12T03:24:36,469 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:36,480 INFO [main] exec.MoveTask: Partition is: {i=null} 2019-03-12T03:24:36,483 INFO [main] exec.Task: 2019-03-12T03:24:36,483 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:36,499 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:36,513 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_names_ps : tbl=hive.default.simple_stats[] 2019-03-12T03:24:36,557 INFO [load-dynamic-partitionsToAdd-0] metadata.Hive: New loading path = file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/-ext-10000/i=1 withPartSpec {i=1} 2019-03-12T03:24:36,557 INFO [load-dynamic-partitionsToAdd-0] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=1 2019-03-12T03:24:36,564 INFO [load-dynamic-partitionsToAdd-0] metadata.Hive: Moving bucket file:///work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-32_685_2442717654601358023-1/-ext-10000/i=1/000000_0/delta_0000001_0000001_0000/bucket_00000 to file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=1/delta_0000001_0000001_0000/bucket_00000 2019-03-12T03:24:36,579 WARN [load-dynamic-partitionsToAdd-0] FileOperations: Computing stats for an ACID table; stats may be inaccurate 2019-03-12T03:24:36,586 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=add_partition 2019-03-12T03:24:36,587 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=add_partitions 2019-03-12T03:24:36,652 INFO [main] metadata.Hive: Loaded 1partitionsToAdd Time taken to load dynamic partitions: 0.169 seconds 2019-03-12T03:24:36,653 INFO [main] exec.Task: Time taken to load dynamic partitions: 0.169 seconds 2019-03-12T03:24:36,653 INFO [main] exec.MoveTask: Time taken to load dynamic partitions: 0.169 seconds 2019-03-12T03:24:36,654 INFO [main] exec.MoveTask: Loading partition {i=1} Time taken for adding to write entity : 0.001 seconds 2019-03-12T03:24:36,654 INFO [main] exec.Task: Time taken for adding to write entity : 0.001 seconds 2019-03-12T03:24:36,654 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase MapReduce Jobs Launched: 2019-03-12T03:24:36,655 INFO [main] ql.Driver: MapReduce Jobs Launched: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 SUCCESS 2019-03-12T03:24:36,664 INFO [main] ql.Driver: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 SUCCESS Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:36,664 INFO [main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:36,664 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb); Time taken: 2.046 seconds 2019-03-12T03:24:36,664 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032432_7e5343a8-3e6d-4f66-9724-073bcca7e9bb 2019-03-12T03:24:36,683 INFO [main] txn.TxnHandler: Removed committed transaction: (5) from MIN_HISTORY_LEVEL 2019-03-12T03:24:36,687 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187): insert into simple_stats (i, s) values (2, 'test2') 2019-03-12T03:24:36,704 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([6]) with min_open_txn: 6 2019-03-12T03:24:36,704 INFO [main] lockmgr.DbTxnManager: Opened txnid:6 2019-03-12T03:24:36,709 INFO [main] parse.CalcitePlanner: Starting Semantic Analysis 2019-03-12T03:24:36,710 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:36,721 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:36,733 INFO [main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis 2019-03-12T03:24:36,733 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:36,733 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:36,733 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:36,733 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:36,742 INFO [main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis 2019-03-12T03:24:36,755 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:36,756 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:36,758 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:36,759 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:36,761 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=_dummy_database foreigntbl=_dummy_table 2019-03-12T03:24:36,783 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_databases: @hive# 2019-03-12T03:24:36,784 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_materialized_views_for_rewriting: db=@hive#default 2019-03-12T03:24:36,791 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:36,800 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:36,800 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:36,800 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:36,800 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:36,802 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:36,802 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:36,802 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:36,802 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:36,817 INFO [main] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1 2019-03-12T03:24:36,820 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.simple_stats 2019-03-12T03:24:36,821 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_check_constraints : tbl=hive.default.simple_stats 2019-03-12T03:24:36,830 INFO [main] txn.TxnHandler: Allocated writeID: 2 for txnId: 6 2019-03-12T03:24:36,833 INFO [main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan. 2019-03-12T03:24:36,834 INFO [main] ppd.OpProcFactory: Processing for FS(4) 2019-03-12T03:24:36,834 INFO [main] ppd.OpProcFactory: Processing for SEL(3) 2019-03-12T03:24:36,834 INFO [main] ppd.OpProcFactory: Processing for UDTF(2) 2019-03-12T03:24:36,834 INFO [main] ppd.OpProcFactory: Processing for SEL(1) 2019-03-12T03:24:36,834 INFO [main] ppd.OpProcFactory: Processing for TS(0) 2019-03-12T03:24:36,835 INFO [main] correlation.AbstractCorrelationProcCtx: Overriding hive.optimize.reducededuplication.min.reducer to 1 due to a write to transactional table(s) default.simple_stats 2019-03-12T03:24:36,848 INFO [main] physical.Vectorizer: Examining input format to see if vectorization is enabled. 2019-03-12T03:24:36,848 INFO [main] physical.Vectorizer: Map vectorization enabled: false 2019-03-12T03:24:36,848 INFO [main] physical.Vectorizer: Map vectorized: false 2019-03-12T03:24:36,848 INFO [main] physical.Vectorizer: Map vectorizedVertexNum: 0 2019-03-12T03:24:36,848 INFO [main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vectorized.input.format IS true] 2019-03-12T03:24:36,848 INFO [main] physical.Vectorizer: Map enabledConditionsNotMet: [Could not enable vectorization due to partition column names size 1 is greater than the number of table column names size 0 IS false] 2019-03-12T03:24:36,848 INFO [main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.hive.ql.io.NullRowsInputFormat] 2019-03-12T03:24:36,848 INFO [main] parse.CalcitePlanner: Completed plan generation 2019-03-12T03:24:36,849 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:36,849 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:string, comment:null), FieldSchema(name:_col1, type:int, comment:null)], properties:null) 2019-03-12T03:24:36,849 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:36,849 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187); Time taken: 0.162 seconds 2019-03-12T03:24:36,849 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:6 for queryId=abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187 2019-03-12T03:24:36,850 INFO [main] lockmgr.DbLockManager: Requesting: queryId=abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187 LockRequest(component:[LockComponent(type:SHARED_READ, level:TABLE, dbname:_dummy_database, tablename:_dummy_table, operationType:SELECT, isTransactional:false), LockComponent(type:SHARED_READ, level:TABLE, dbname:default, tablename:simple_stats, operationType:INSERT, isTransactional:true, isDynamicPartitionWrite:true)], txnid:6, user:abapat, hostname:ubuntu, agentInfo:abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187) 2019-03-12T03:24:36,868 INFO [main] lockmgr.DbLockManager: Response to queryId=abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187 LockResponse(lockid:3, state:ACQUIRED) 2019-03-12T03:24:36,868 INFO [main] ql.Driver: Operation QUERY obtained 1 locks 2019-03-12T03:24:36,876 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187): insert into simple_stats (i, s) values (2, 'test2') 2019-03-12T03:24:36,876 WARN [main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. Query ID = abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187 2019-03-12T03:24:36,877 INFO [main] ql.Driver: Query ID = abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187 Total jobs = 1 2019-03-12T03:24:36,877 INFO [main] ql.Driver: Total jobs = 1 Launching Job 1 out of 1 2019-03-12T03:24:36,877 INFO [main] ql.Driver: Launching Job 1 out of 1 2019-03-12T03:24:36,882 INFO [main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode Number of reduce tasks is set to 0 since there's no reduce operator 2019-03-12T03:24:36,882 INFO [main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator 2019-03-12T03:24:36,884 INFO [main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.HiveInputFormat 2019-03-12T03:24:36,885 INFO [main] exec.Utilities: Processing alias $hdt$_0:_dummy_table 2019-03-12T03:24:36,885 INFO [main] exec.Utilities: Adding 1 inputs; the first input is file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-36_687_2057516504815278373-1/dummy_path 2019-03-12T03:24:36,894 INFO [main] exec.SerializationUtilities: Serializing MapWork using kryo 2019-03-12T03:24:36,903 INFO [main] exec.Utilities: Serialized plan (via FILE) - name: null size: 5.43KB 2019-03-12T03:24:36,904 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:36,908 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:36,915 WARN [main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2019-03-12T03:24:36,920 WARN [main] mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2019-03-12T03:24:36,920 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.ids = 2019-03-12T03:24:36,920 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.names = 2019-03-12T03:24:36,920 INFO [main] io.HiveInputFormat: Generating splits for dirs: file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-36_687_2057516504815278373-1/dummy_path 2019-03-12T03:24:36,921 INFO [main] io.HiveInputFormat: number of splits 1 2019-03-12T03:24:36,938 INFO [main] mapreduce.JobSubmitter: number of splits:1 2019-03-12T03:24:36,957 INFO [main] mapreduce.JobSubmitter: Submitting tokens for job: job_local1255176435_0002 2019-03-12T03:24:36,957 INFO [main] mapreduce.JobSubmitter: Executing with tokens: [] 2019-03-12T03:24:37,018 INFO [main] mapreduce.Job: The url to track the job: http://localhost:8080/ Job running in-process (local Hadoop) 2019-03-12T03:24:37,019 INFO [main] exec.Task: Job running in-process (local Hadoop) 2019-03-12T03:24:37,019 INFO [Thread-136] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:37,020 INFO [Thread-136] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:37,022 INFO [Thread-136] mapred.LocalJobRunner: Waiting for map tasks 2019-03-12T03:24:37,022 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local1255176435_0002_m_000000_0 2019-03-12T03:24:37,024 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2019-03-12T03:24:37,024 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: org.apache.hadoop.hive.ql.io.NullRowsInputFormat:file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-36_687_2057516504815278373-1/dummy_path/null:0+1 2019-03-12T03:24:37,025 INFO [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:37,029 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.43KB 2019-03-12T03:24:37,030 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 0 2019-03-12T03:24:37,031 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: conf classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:37,031 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: thread classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:37,031 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Initializing Operator: MAP[0] 2019-03-12T03:24:37,031 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: Id =0 null <\Children> <\Parent> <\MAP> 2019-03-12T03:24:37,032 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing Operator: TS[0] 2019-03-12T03:24:37,032 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[1] 2019-03-12T03:24:37,032 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT null 2019-03-12T03:24:37,032 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: Initializing Operator: UDTF[2] 2019-03-12T03:24:37,032 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[3] 2019-03-12T03:24:37,032 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT struct 2019-03-12T03:24:37,032 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Initializing Operator: FS[4] 2019-03-12T03:24:37,033 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.ql.io.orc.OrcSerde@3c0b2ffb and formatter : org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat@9f26fb 2019-03-12T03:24:37,033 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Final Path: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/_tmp.-ext-10000/i=2/000000_0 2019-03-12T03:24:37,033 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Writing to temp file: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/_task_tmp.-ext-10000/i=2/_tmp.000000_0 2019-03-12T03:24:37,033 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: New Final Path: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/_tmp.-ext-10000/i=2/000000_0 2019-03-12T03:24:37,038 INFO [LocalJobRunner Map Task Executor #0] impl.MemoryManagerImpl: orc.rows.between.memory.checks=5000 2019-03-12T03:24:37,039 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1 2019-03-12T03:24:37,039 INFO [LocalJobRunner Map Task Executor #0] impl.PhysicalFsWriter: ORC writer created for path: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/_task_tmp.-ext-10000/i=2/_tmp.000000_0/delta_0000002_0000002_0000/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768 2019-03-12T03:24:37,047 INFO [LocalJobRunner Map Task Executor #0] impl.WriterImpl: ORC writer created for path: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/_task_tmp.-ext-10000/i=2/_tmp.000000_0/delta_0000002_0000002_0000/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: records read - 1 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Closing Operator: MAP[0] 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: Total records read - 3. abort - false 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:3, RECORDS_OUT_OPERATOR_MAP_0:0, 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Closing Operator: TS[0] 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:1, 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[1] 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_SEL_1:1, 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: Closing Operator: UDTF[2] 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: RECORDS_OUT_OPERATOR_UDTF_2:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[3] 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_OPERATOR_SEL_3:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Closing Operator: FS[4] 2019-03-12T03:24:37,051 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1 2019-03-12T03:24:37,054 INFO [LocalJobRunner Map Task Executor #0] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/_tmp.-ext-10000/i=2 2019-03-12T03:24:37,056 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: RECORDS_OUT_1_default.simple_stats:1, RECORDS_OUT_OPERATOR_FS_4:1, RECORDS_OUT_INTERMEDIATE:0, TOTAL_TABLE_ROWS_WRITTEN:1, 2019-03-12T03:24:37,057 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2019-03-12T03:24:37,057 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local1255176435_0002_m_000000_0 is done. And is in the process of committing 2019-03-12T03:24:37,058 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: map 2019-03-12T03:24:37,059 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local1255176435_0002_m_000000_0' done. 2019-03-12T03:24:37,059 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1255176435_0002_m_000000_0: Counters: 28 File System Counters FILE: Number of bytes read=11731 FILE: Number of bytes written=2228026 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Map input records=4 Map output records=0 Input split bytes=351 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=0 Total committed heap usage (bytes)=694681600 HIVE CREATED_DYNAMIC_PARTITIONS=1 CREATED_FILES=1 DESERIALIZE_ERRORS=0 RECORDS_IN=3 RECORDS_OUT_1_default.simple_stats=1 RECORDS_OUT_INTERMEDIATE=0 RECORDS_OUT_OPERATOR_FS_4=1 RECORDS_OUT_OPERATOR_MAP_0=0 RECORDS_OUT_OPERATOR_SEL_1=1 RECORDS_OUT_OPERATOR_SEL_3=1 RECORDS_OUT_OPERATOR_TS_0=1 RECORDS_OUT_OPERATOR_UDTF_2=1 TOTAL_TABLE_ROWS_WRITTEN=1 File Input Format Counters Bytes Read=5484 File Output Format Counters Bytes Written=0 2019-03-12T03:24:37,059 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local1255176435_0002_m_000000_0 2019-03-12T03:24:37,059 INFO [Thread-136] mapred.LocalJobRunner: map task executor complete. 2019-03-12 03:24:38,027 Stage-1 map = 100%, reduce = 0% 2019-03-12T03:24:38,027 INFO [main] exec.Task: 2019-03-12 03:24:38,027 Stage-1 map = 100%, reduce = 0% Ended Job = job_local1255176435_0002 2019-03-12T03:24:38,029 INFO [main] exec.Task: Ended Job = job_local1255176435_0002 2019-03-12T03:24:38,031 INFO [main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode Loading data to table default.simple_stats partition (i=null) 2019-03-12T03:24:38,032 INFO [main] exec.Task: Loading data to table default.simple_stats partition (i=null) from file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/-ext-10000 2019-03-12T03:24:38,032 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:38,043 INFO [main] exec.MoveTask: Partition is: {i=null} 2019-03-12T03:24:38,044 INFO [main] exec.Task: 2019-03-12T03:24:38,044 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:38,058 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:38,070 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_names_ps : tbl=hive.default.simple_stats[] 2019-03-12T03:24:38,091 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_by_names : tbl=hive.default.simple_stats 2019-03-12T03:24:38,154 INFO [load-dynamic-partitionsToAdd-0] metadata.Hive: New loading path = file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/-ext-10000/i=2 withPartSpec {i=2} 2019-03-12T03:24:38,154 INFO [load-dynamic-partitionsToAdd-0] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=2 2019-03-12T03:24:38,160 INFO [load-dynamic-partitionsToAdd-0] metadata.Hive: Moving bucket file:///work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-36_687_2057516504815278373-1/-ext-10000/i=2/000000_0/delta_0000002_0000002_0000/bucket_00000 to file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=2/delta_0000002_0000002_0000/bucket_00000 2019-03-12T03:24:38,164 WARN [load-dynamic-partitionsToAdd-0] FileOperations: Computing stats for an ACID table; stats may be inaccurate 2019-03-12T03:24:38,165 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=add_partition 2019-03-12T03:24:38,165 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=add_partitions 2019-03-12T03:24:38,185 INFO [main] metadata.Hive: Loaded 1partitionsToAdd Time taken to load dynamic partitions: 0.141 seconds 2019-03-12T03:24:38,185 INFO [main] exec.Task: Time taken to load dynamic partitions: 0.141 seconds 2019-03-12T03:24:38,185 INFO [main] exec.MoveTask: Time taken to load dynamic partitions: 0.141 seconds 2019-03-12T03:24:38,185 INFO [main] exec.MoveTask: Loading partition {i=2} Time taken for adding to write entity : 0.0 seconds 2019-03-12T03:24:38,185 INFO [main] exec.Task: Time taken for adding to write entity : 0.0 seconds 2019-03-12T03:24:38,185 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase MapReduce Jobs Launched: 2019-03-12T03:24:38,186 INFO [main] ql.Driver: MapReduce Jobs Launched: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 SUCCESS 2019-03-12T03:24:38,186 INFO [main] ql.Driver: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 SUCCESS Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:38,186 INFO [main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:38,186 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187); Time taken: 1.309 seconds 2019-03-12T03:24:38,186 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032436_d8fe4cb0-e76b-4c0f-9d92-10d34f210187 2019-03-12T03:24:38,201 INFO [main] txn.TxnHandler: Removed committed transaction: (6) from MIN_HISTORY_LEVEL 2019-03-12T03:24:38,205 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89): insert into simple_stats (i, s) values (3, 'test3') 2019-03-12T03:24:38,215 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([7]) with min_open_txn: 7 2019-03-12T03:24:38,216 INFO [main] lockmgr.DbTxnManager: Opened txnid:7 2019-03-12T03:24:38,218 INFO [main] parse.CalcitePlanner: Starting Semantic Analysis 2019-03-12T03:24:38,219 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:38,274 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:38,287 INFO [main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis 2019-03-12T03:24:38,287 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:38,287 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:38,287 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:38,287 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:38,298 INFO [main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis 2019-03-12T03:24:38,311 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:38,321 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:38,329 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:38,330 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:38,338 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=_dummy_database foreigntbl=_dummy_table 2019-03-12T03:24:38,354 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_databases: @hive# 2019-03-12T03:24:38,357 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_materialized_views_for_rewriting: db=@hive#default 2019-03-12T03:24:38,365 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:38,373 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:38,373 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:38,373 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:38,373 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:38,374 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:38,374 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:38,374 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:38,374 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:38,386 INFO [main] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1 2019-03-12T03:24:38,389 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.simple_stats 2019-03-12T03:24:38,391 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_check_constraints : tbl=hive.default.simple_stats 2019-03-12T03:24:38,415 INFO [main] txn.TxnHandler: Allocated writeID: 3 for txnId: 7 2019-03-12T03:24:38,418 INFO [main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan. 2019-03-12T03:24:38,419 INFO [main] ppd.OpProcFactory: Processing for FS(4) 2019-03-12T03:24:38,419 INFO [main] ppd.OpProcFactory: Processing for SEL(3) 2019-03-12T03:24:38,419 INFO [main] ppd.OpProcFactory: Processing for UDTF(2) 2019-03-12T03:24:38,419 INFO [main] ppd.OpProcFactory: Processing for SEL(1) 2019-03-12T03:24:38,419 INFO [main] ppd.OpProcFactory: Processing for TS(0) 2019-03-12T03:24:38,420 INFO [main] correlation.AbstractCorrelationProcCtx: Overriding hive.optimize.reducededuplication.min.reducer to 1 due to a write to transactional table(s) default.simple_stats 2019-03-12T03:24:38,435 INFO [main] physical.Vectorizer: Examining input format to see if vectorization is enabled. 2019-03-12T03:24:38,435 INFO [main] physical.Vectorizer: Map vectorization enabled: false 2019-03-12T03:24:38,435 INFO [main] physical.Vectorizer: Map vectorized: false 2019-03-12T03:24:38,435 INFO [main] physical.Vectorizer: Map vectorizedVertexNum: 0 2019-03-12T03:24:38,435 INFO [main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vectorized.input.format IS true] 2019-03-12T03:24:38,435 INFO [main] physical.Vectorizer: Map enabledConditionsNotMet: [Could not enable vectorization due to partition column names size 1 is greater than the number of table column names size 0 IS false] 2019-03-12T03:24:38,435 INFO [main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.hive.ql.io.NullRowsInputFormat] 2019-03-12T03:24:38,435 INFO [main] parse.CalcitePlanner: Completed plan generation 2019-03-12T03:24:38,435 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:38,435 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:string, comment:null), FieldSchema(name:_col1, type:int, comment:null)], properties:null) 2019-03-12T03:24:38,436 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:38,436 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89); Time taken: 0.23 seconds 2019-03-12T03:24:38,436 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:7 for queryId=abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89 2019-03-12T03:24:38,436 INFO [main] lockmgr.DbLockManager: Requesting: queryId=abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89 LockRequest(component:[LockComponent(type:SHARED_READ, level:TABLE, dbname:_dummy_database, tablename:_dummy_table, operationType:SELECT, isTransactional:false), LockComponent(type:SHARED_READ, level:TABLE, dbname:default, tablename:simple_stats, operationType:INSERT, isTransactional:true, isDynamicPartitionWrite:true)], txnid:7, user:abapat, hostname:ubuntu, agentInfo:abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89) 2019-03-12T03:24:38,454 INFO [main] lockmgr.DbLockManager: Response to queryId=abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89 LockResponse(lockid:4, state:ACQUIRED) 2019-03-12T03:24:38,454 INFO [main] ql.Driver: Operation QUERY obtained 1 locks 2019-03-12T03:24:38,463 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89): insert into simple_stats (i, s) values (3, 'test3') 2019-03-12T03:24:38,463 WARN [main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. Query ID = abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89 2019-03-12T03:24:38,463 INFO [main] ql.Driver: Query ID = abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89 Total jobs = 1 2019-03-12T03:24:38,463 INFO [main] ql.Driver: Total jobs = 1 Launching Job 1 out of 1 2019-03-12T03:24:38,464 INFO [main] ql.Driver: Launching Job 1 out of 1 2019-03-12T03:24:38,466 INFO [main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode Number of reduce tasks is set to 0 since there's no reduce operator 2019-03-12T03:24:38,466 INFO [main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator 2019-03-12T03:24:38,469 INFO [main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.HiveInputFormat 2019-03-12T03:24:38,469 INFO [main] exec.Utilities: Processing alias $hdt$_0:_dummy_table 2019-03-12T03:24:38,469 INFO [main] exec.Utilities: Adding 1 inputs; the first input is file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-38_206_7792008413247120272-1/dummy_path 2019-03-12T03:24:38,479 INFO [main] exec.SerializationUtilities: Serializing MapWork using kryo 2019-03-12T03:24:38,482 INFO [main] exec.Utilities: Serialized plan (via FILE) - name: null size: 5.43KB 2019-03-12T03:24:38,483 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:38,488 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:38,494 WARN [main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2019-03-12T03:24:38,498 WARN [main] mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2019-03-12T03:24:38,498 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.ids = 2019-03-12T03:24:38,499 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.names = 2019-03-12T03:24:38,499 INFO [main] io.HiveInputFormat: Generating splits for dirs: file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-38_206_7792008413247120272-1/dummy_path 2019-03-12T03:24:38,499 INFO [main] io.HiveInputFormat: number of splits 1 2019-03-12T03:24:38,517 INFO [main] mapreduce.JobSubmitter: number of splits:1 2019-03-12T03:24:38,540 INFO [main] mapreduce.JobSubmitter: Submitting tokens for job: job_local575460591_0003 2019-03-12T03:24:38,540 INFO [main] mapreduce.JobSubmitter: Executing with tokens: [] 2019-03-12T03:24:38,618 INFO [main] mapreduce.Job: The url to track the job: http://localhost:8080/ Job running in-process (local Hadoop) 2019-03-12T03:24:38,619 INFO [main] exec.Task: Job running in-process (local Hadoop) 2019-03-12T03:24:38,619 INFO [Thread-181] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:38,619 INFO [Thread-181] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:38,622 INFO [Thread-181] mapred.LocalJobRunner: Waiting for map tasks 2019-03-12T03:24:38,622 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local575460591_0003_m_000000_0 2019-03-12T03:24:38,625 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2019-03-12T03:24:38,626 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: org.apache.hadoop.hive.ql.io.NullRowsInputFormat:file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-38_206_7792008413247120272-1/dummy_path/null:0+1 2019-03-12T03:24:38,627 INFO [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:38,629 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.43KB 2019-03-12T03:24:38,630 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 0 2019-03-12T03:24:38,630 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: conf classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:38,631 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: thread classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:38,631 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Initializing Operator: MAP[0] 2019-03-12T03:24:38,631 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: Id =0 null <\Children> <\Parent> <\MAP> 2019-03-12T03:24:38,632 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing Operator: TS[0] 2019-03-12T03:24:38,632 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[1] 2019-03-12T03:24:38,633 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT null 2019-03-12T03:24:38,633 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: Initializing Operator: UDTF[2] 2019-03-12T03:24:38,633 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[3] 2019-03-12T03:24:38,633 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT struct 2019-03-12T03:24:38,634 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Initializing Operator: FS[4] 2019-03-12T03:24:38,634 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.ql.io.orc.OrcSerde@1d3a45d3 and formatter : org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat@233390b 2019-03-12T03:24:38,635 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Final Path: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/_tmp.-ext-10000/i=3/000000_0 2019-03-12T03:24:38,635 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Writing to temp file: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/_task_tmp.-ext-10000/i=3/_tmp.000000_0 2019-03-12T03:24:38,635 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: New Final Path: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/_tmp.-ext-10000/i=3/000000_0 2019-03-12T03:24:38,639 INFO [LocalJobRunner Map Task Executor #0] impl.MemoryManagerImpl: orc.rows.between.memory.checks=5000 2019-03-12T03:24:38,640 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1 2019-03-12T03:24:38,640 INFO [LocalJobRunner Map Task Executor #0] impl.PhysicalFsWriter: ORC writer created for path: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/_task_tmp.-ext-10000/i=3/_tmp.000000_0/delta_0000003_0000003_0000/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768 2019-03-12T03:24:38,650 INFO [LocalJobRunner Map Task Executor #0] impl.WriterImpl: ORC writer created for path: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/_task_tmp.-ext-10000/i=3/_tmp.000000_0/delta_0000003_0000003_0000/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768 2019-03-12T03:24:38,654 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: records read - 1 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Closing Operator: MAP[0] 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: Total records read - 3. abort - false 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:3, RECORDS_OUT_OPERATOR_MAP_0:0, 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Closing Operator: TS[0] 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:1, 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[1] 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_SEL_1:1, 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: Closing Operator: UDTF[2] 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: RECORDS_OUT_OPERATOR_UDTF_2:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:38,655 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[3] 2019-03-12T03:24:38,656 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_OPERATOR_SEL_3:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:38,656 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Closing Operator: FS[4] 2019-03-12T03:24:38,656 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1 2019-03-12T03:24:38,659 INFO [LocalJobRunner Map Task Executor #0] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/_tmp.-ext-10000/i=3 2019-03-12T03:24:38,662 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: RECORDS_OUT_1_default.simple_stats:1, RECORDS_OUT_OPERATOR_FS_4:1, RECORDS_OUT_INTERMEDIATE:0, TOTAL_TABLE_ROWS_WRITTEN:1, 2019-03-12T03:24:38,663 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2019-03-12T03:24:38,663 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local575460591_0003_m_000000_0 is done. And is in the process of committing 2019-03-12T03:24:38,664 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: map 2019-03-12T03:24:38,664 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local575460591_0003_m_000000_0' done. 2019-03-12T03:24:38,665 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local575460591_0003_m_000000_0: Counters: 28 File System Counters FILE: Number of bytes read=17610 FILE: Number of bytes written=3337650 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Map input records=4 Map output records=0 Input split bytes=351 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=0 Total committed heap usage (bytes)=694681600 HIVE CREATED_DYNAMIC_PARTITIONS=1 CREATED_FILES=1 DESERIALIZE_ERRORS=0 RECORDS_IN=3 RECORDS_OUT_1_default.simple_stats=1 RECORDS_OUT_INTERMEDIATE=0 RECORDS_OUT_OPERATOR_FS_4=1 RECORDS_OUT_OPERATOR_MAP_0=0 RECORDS_OUT_OPERATOR_SEL_1=1 RECORDS_OUT_OPERATOR_SEL_3=1 RECORDS_OUT_OPERATOR_TS_0=1 RECORDS_OUT_OPERATOR_UDTF_2=1 TOTAL_TABLE_ROWS_WRITTEN=1 File Input Format Counters Bytes Read=5484 File Output Format Counters Bytes Written=0 2019-03-12T03:24:38,665 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local575460591_0003_m_000000_0 2019-03-12T03:24:38,665 INFO [Thread-181] mapred.LocalJobRunner: map task executor complete. 2019-03-12 03:24:39,626 Stage-1 map = 100%, reduce = 0% 2019-03-12T03:24:39,627 INFO [main] exec.Task: 2019-03-12 03:24:39,626 Stage-1 map = 100%, reduce = 0% Ended Job = job_local575460591_0003 2019-03-12T03:24:39,628 INFO [main] exec.Task: Ended Job = job_local575460591_0003 2019-03-12T03:24:39,630 INFO [main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode Loading data to table default.simple_stats partition (i=null) 2019-03-12T03:24:39,631 INFO [main] exec.Task: Loading data to table default.simple_stats partition (i=null) from file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/-ext-10000 2019-03-12T03:24:39,631 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:39,641 INFO [main] exec.MoveTask: Partition is: {i=null} 2019-03-12T03:24:39,642 INFO [main] exec.Task: 2019-03-12T03:24:39,643 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:39,654 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:39,662 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_names_ps : tbl=hive.default.simple_stats[] 2019-03-12T03:24:39,690 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_by_names : tbl=hive.default.simple_stats 2019-03-12T03:24:39,736 INFO [load-dynamic-partitionsToAdd-0] metadata.Hive: New loading path = file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/-ext-10000/i=3 withPartSpec {i=3} 2019-03-12T03:24:39,736 INFO [load-dynamic-partitionsToAdd-0] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=3 2019-03-12T03:24:39,742 INFO [load-dynamic-partitionsToAdd-0] metadata.Hive: Moving bucket file:///work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-38_206_7792008413247120272-1/-ext-10000/i=3/000000_0/delta_0000003_0000003_0000/bucket_00000 to file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=3/delta_0000003_0000003_0000/bucket_00000 2019-03-12T03:24:39,768 WARN [load-dynamic-partitionsToAdd-0] FileOperations: Computing stats for an ACID table; stats may be inaccurate 2019-03-12T03:24:39,775 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=add_partition 2019-03-12T03:24:39,775 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=add_partitions 2019-03-12T03:24:39,815 INFO [main] metadata.Hive: Loaded 1partitionsToAdd Time taken to load dynamic partitions: 0.172 seconds 2019-03-12T03:24:39,815 INFO [main] exec.Task: Time taken to load dynamic partitions: 0.172 seconds 2019-03-12T03:24:39,815 INFO [main] exec.MoveTask: Time taken to load dynamic partitions: 0.172 seconds 2019-03-12T03:24:39,815 INFO [main] exec.MoveTask: Loading partition {i=3} Time taken for adding to write entity : 0.0 seconds 2019-03-12T03:24:39,815 INFO [main] exec.Task: Time taken for adding to write entity : 0.0 seconds 2019-03-12T03:24:39,816 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase MapReduce Jobs Launched: 2019-03-12T03:24:39,816 INFO [main] ql.Driver: MapReduce Jobs Launched: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 SUCCESS 2019-03-12T03:24:39,816 INFO [main] ql.Driver: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 SUCCESS Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:39,816 INFO [main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:39,816 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89); Time taken: 1.353 seconds 2019-03-12T03:24:39,816 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032438_cd1d9a5b-b1e3-43ef-8e99-03dabd60ab89 2019-03-12T03:24:39,831 INFO [main] txn.TxnHandler: Removed committed transaction: (7) from MIN_HISTORY_LEVEL 2019-03-12T03:24:39,966 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483): analyze table default.simple_stats partition(i) compute statistics for columns s 2019-03-12T03:24:39,977 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([8]) with min_open_txn: 8 2019-03-12T03:24:39,977 INFO [main] lockmgr.DbTxnManager: Opened txnid:8 2019-03-12T03:24:39,981 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:39,989 WARN [main] parse.BaseSemanticAnalyzer: Dynamic partitioning is used; only validating 0 columns 2019-03-12T03:24:39,994 INFO [main] parse.ColumnStatsSemanticAnalyzer: Invoking analyze on rewritten query 2019-03-12T03:24:39,995 INFO [main] parse.ColumnStatsSemanticAnalyzer: Starting Semantic Analysis 2019-03-12T03:24:39,995 INFO [main] parse.ColumnStatsSemanticAnalyzer: Completed phase 1 of Semantic Analysis 2019-03-12T03:24:39,995 INFO [main] parse.ColumnStatsSemanticAnalyzer: Get metadata for source tables 2019-03-12T03:24:39,996 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:40,010 INFO [main] parse.ColumnStatsSemanticAnalyzer: Get metadata for subqueries 2019-03-12T03:24:40,010 INFO [main] parse.ColumnStatsSemanticAnalyzer: Get metadata for destination tables 2019-03-12T03:24:40,011 INFO [main] parse.ColumnStatsSemanticAnalyzer: Completed getting MetaData in Semantic Analysis 2019-03-12T03:24:40,025 INFO [main] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-39_990_7460911005596272972-1/-mr-10000/.hive-staging_hive_2019-03-12_03-24-39_990_7460911005596272972-1 2019-03-12T03:24:40,077 INFO [main] ppd.OpProcFactory: Processing for FS(6) 2019-03-12T03:24:40,077 INFO [main] ppd.OpProcFactory: Processing for SEL(5) 2019-03-12T03:24:40,077 INFO [main] ppd.OpProcFactory: Processing for GBY(4) 2019-03-12T03:24:40,077 INFO [main] ppd.OpProcFactory: Processing for RS(3) 2019-03-12T03:24:40,077 INFO [main] ppd.OpProcFactory: Processing for GBY(2) 2019-03-12T03:24:40,077 INFO [main] ppd.OpProcFactory: Processing for SEL(1) 2019-03-12T03:24:40,077 INFO [main] ppd.OpProcFactory: Processing for TS(0) 2019-03-12T03:24:40,079 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions : tbl=hive.default.simple_stats 2019-03-12T03:24:40,099 INFO [main] optimizer.ColumnPrunerProcFactory: RS 3 oldColExprMap: {KEY._col0=Column[_col0], VALUE._col0=Column[_col1]} 2019-03-12T03:24:40,099 INFO [main] optimizer.ColumnPrunerProcFactory: RS 3 newColExprMap: {KEY._col0=Column[_col0], VALUE._col0=Column[_col1]} 2019-03-12T03:24:40,116 INFO [main] physical.Vectorizer: Examining input format to see if vectorization is enabled. 2019-03-12T03:24:40,118 INFO [main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.hive.ql.io.orc.OrcInputFormat] 2019-03-12T03:24:40,118 INFO [main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0) 2019-03-12T03:24:40,119 INFO [main] physical.Vectorizer: Map vectorization enabled: true 2019-03-12T03:24:40,119 INFO [main] physical.Vectorizer: Map vectorized: false 2019-03-12T03:24:40,119 INFO [main] physical.Vectorizer: Map notVectorizedReason: TABLESCAN operator: gather stats not supported 2019-03-12T03:24:40,119 INFO [main] physical.Vectorizer: Map vectorizedVertexNum: 0 2019-03-12T03:24:40,119 INFO [main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vectorized.input.format IS true] 2019-03-12T03:24:40,119 INFO [main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.hive.ql.io.orc.OrcInputFormat] 2019-03-12T03:24:40,119 INFO [main] physical.Vectorizer: Reduce vectorization enabled: false 2019-03-12T03:24:40,120 INFO [main] physical.Vectorizer: Reduce vectorized: false 2019-03-12T03:24:40,120 INFO [main] physical.Vectorizer: Reduce vectorizedVertexNum: 1 2019-03-12T03:24:40,120 INFO [main] physical.Vectorizer: Reducer hive.vectorized.execution.reduce.enabled: true 2019-03-12T03:24:40,120 INFO [main] physical.Vectorizer: Reducer engine: mr 2019-03-12T03:24:40,127 INFO [main] parse.ColumnStatsSemanticAnalyzer: Completed plan generation 2019-03-12T03:24:40,127 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:40,128 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_ps_with_auth : tbl=hive.default.simple_stats[1] 2019-03-12T03:24:40,178 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_ps_with_auth : tbl=hive.default.simple_stats[2] 2019-03-12T03:24:40,206 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_ps_with_auth : tbl=hive.default.simple_stats[3] 2019-03-12T03:24:40,234 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_c0, type:struct, comment:null), FieldSchema(name:i, type:int, comment:null)], properties:null) 2019-03-12T03:24:40,235 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:40,235 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483); Time taken: 0.269 seconds 2019-03-12T03:24:40,243 INFO [main] txn.TxnHandler: Allocated writeID: 4 for txnId: 8 2019-03-12T03:24:40,247 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:8 for queryId=abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483 2019-03-12T03:24:40,247 INFO [main] lockmgr.DbLockManager: Requesting: queryId=abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483 LockRequest(component:[LockComponent(type:SHARED_READ, level:PARTITION, dbname:default, tablename:simple_stats, partitionname:i=3, operationType:SELECT, isTransactional:true), LockComponent(type:SHARED_READ, level:TABLE, dbname:default, tablename:simple_stats, operationType:SELECT, isTransactional:true), LockComponent(type:SHARED_READ, level:PARTITION, dbname:default, tablename:simple_stats, partitionname:i=2, operationType:SELECT, isTransactional:true), LockComponent(type:SHARED_READ, level:PARTITION, dbname:default, tablename:simple_stats, partitionname:i=1, operationType:SELECT, isTransactional:true)], txnid:8, user:abapat, hostname:ubuntu, agentInfo:abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483) 2019-03-12T03:24:40,269 INFO [main] lockmgr.DbLockManager: Response to queryId=abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483 LockResponse(lockid:5, state:ACQUIRED) 2019-03-12T03:24:40,269 INFO [main] ql.Driver: Operation ANALYZE_TABLE obtained 1 locks 2019-03-12T03:24:40,278 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483): analyze table default.simple_stats partition(i) compute statistics for columns s 2019-03-12T03:24:40,278 WARN [main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. Query ID = abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483 2019-03-12T03:24:40,278 INFO [main] ql.Driver: Query ID = abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483 Total jobs = 1 2019-03-12T03:24:40,278 INFO [main] ql.Driver: Total jobs = 1 Launching Job 1 out of 1 2019-03-12T03:24:40,279 INFO [main] ql.Driver: Launching Job 1 out of 1 2019-03-12T03:24:40,281 INFO [main] ql.Driver: Starting task [Stage-0:MAPRED] in serial mode 2019-03-12T03:24:40,287 INFO [main] exec.Utilities: BytesPerReducer=256000000 maxReducers=1009 totalInputFileSize=1983 Number of reduce tasks not specified. Estimated from input data size: 1 2019-03-12T03:24:40,287 INFO [main] exec.Task: Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): 2019-03-12T03:24:40,287 INFO [main] exec.Task: In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= 2019-03-12T03:24:40,287 INFO [main] exec.Task: set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: 2019-03-12T03:24:40,287 INFO [main] exec.Task: In order to limit the maximum number of reducers: set hive.exec.reducers.max= 2019-03-12T03:24:40,288 INFO [main] exec.Task: set hive.exec.reducers.max= In order to set a constant number of reducers: 2019-03-12T03:24:40,288 INFO [main] exec.Task: In order to set a constant number of reducers: set mapreduce.job.reduces= 2019-03-12T03:24:40,288 INFO [main] exec.Task: set mapreduce.job.reduces= 2019-03-12T03:24:40,292 INFO [main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.HiveInputFormat 2019-03-12T03:24:40,292 INFO [main] exec.Utilities: Processing alias simple_stats 2019-03-12T03:24:40,293 INFO [main] exec.Utilities: Adding 3 inputs; the first input is file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=1 2019-03-12T03:24:40,300 INFO [main] exec.SerializationUtilities: Serializing MapWork using kryo 2019-03-12T03:24:40,308 INFO [main] exec.Utilities: Serialized plan (via FILE) - name: null size: 5.88KB 2019-03-12T03:24:40,312 INFO [main] exec.SerializationUtilities: Serializing ReduceWork using kryo 2019-03-12T03:24:40,314 INFO [main] exec.Utilities: Serialized plan (via FILE) - name: null size: 5.43KB 2019-03-12T03:24:40,315 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:40,323 INFO [main] fs.FSStatsPublisher: created : file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-39_990_7460911005596272972-1/-mr-10001 2019-03-12T03:24:40,326 INFO [main] fs.FSStatsPublisher: created : file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-39_990_7460911005596272972-1/-mr-10003 2019-03-12T03:24:40,329 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:40,335 WARN [main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2019-03-12T03:24:40,339 WARN [main] mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2019-03-12T03:24:40,340 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.ids = 0 2019-03-12T03:24:40,340 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.names = s 2019-03-12T03:24:40,340 INFO [main] io.HiveInputFormat: Generating splits for dirs: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=1 2019-03-12T03:24:40,347 INFO [main] orc.OrcInputFormat: ORC pushdown predicate: null 2019-03-12T03:24:40,351 ERROR [ORC_GET_SPLITS #1] io.AcidUtils: Failed to get files with ID; using regular API: Only supported for DFS; got class org.apache.hadoop.hive.ql.io.ProxyLocalFileSystem 2019-03-12T03:24:40,351 ERROR [ORC_GET_SPLITS #0] io.AcidUtils: Failed to get files with ID; using regular API: Only supported for DFS; got class org.apache.hadoop.hive.ql.io.ProxyLocalFileSystem 2019-03-12T03:24:40,375 INFO [ORC_GET_SPLITS #7] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:40,378 INFO [ORC_GET_SPLITS #8] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:40,378 INFO [ORC_GET_SPLITS #6] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:40,385 INFO [ORC_GET_SPLITS #7] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.88KB 2019-03-12T03:24:40,388 INFO [ORC_GET_SPLITS #8] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.88KB 2019-03-12T03:24:40,390 INFO [ORC_GET_SPLITS #6] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.88KB 2019-03-12T03:24:40,398 INFO [ORC_GET_SPLITS #6] impl.OrcCodecPool: Got brand-new codec ZLIB 2019-03-12T03:24:40,398 INFO [ORC_GET_SPLITS #8] impl.OrcCodecPool: Got brand-new codec ZLIB 2019-03-12T03:24:40,412 INFO [main] orc.OrcInputFormat: FooterCacheHitRatio: 0/3 2019-03-12T03:24:40,413 INFO [main] io.HiveInputFormat: number of splits 3 2019-03-12T03:24:40,431 INFO [main] mapreduce.JobSubmitter: number of splits:3 2019-03-12T03:24:40,449 INFO [main] mapreduce.JobSubmitter: Submitting tokens for job: job_local829920451_0004 2019-03-12T03:24:40,450 INFO [main] mapreduce.JobSubmitter: Executing with tokens: [] 2019-03-12T03:24:40,526 INFO [main] mapreduce.Job: The url to track the job: http://localhost:8080/ 2019-03-12T03:24:40,526 INFO [Thread-238] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter Job running in-process (local Hadoop) 2019-03-12T03:24:40,527 INFO [main] exec.Task: Job running in-process (local Hadoop) 2019-03-12T03:24:40,527 INFO [Thread-238] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:40,530 INFO [Thread-238] mapred.LocalJobRunner: Waiting for map tasks 2019-03-12T03:24:40,530 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local829920451_0004_m_000000_0 2019-03-12T03:24:40,531 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2019-03-12T03:24:40,532 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: org.apache.hadoop.hive.ql.io.orc.OrcInputFormat:OrcSplit [file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=3/delta_0000003_0000003_0000/bucket_00000, start=3, length=296, isOriginal=false, fileLength=661, hasFooter=false, hasBase=true, deltas=0] 2019-03-12T03:24:40,549 INFO [LocalJobRunner Map Task Executor #0] orc.OrcRawRecordMerger: min key = null, max key = null 2019-03-12T03:24:40,550 INFO [LocalJobRunner Map Task Executor #0] orc.ReaderImpl: Reading ORC rows from file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=3/delta_0000003_0000003_0000/bucket_00000 with {include: [true, true], offset: 3, length: 296, schema: struct, includeAcidColumns: true} 2019-03-12T03:24:40,569 INFO [LocalJobRunner Map Task Executor #0] orc.OrcRawRecordMerger: updated min key = null, max key = null 2019-03-12T03:24:40,570 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 1 2019-03-12T03:24:40,582 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2019-03-12T03:24:40,582 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2019-03-12T03:24:40,582 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2019-03-12T03:24:40,582 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2019-03-12T03:24:40,582 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2019-03-12T03:24:40,585 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2019-03-12T03:24:40,585 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: conf classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:40,585 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: thread classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:40,585 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Initializing Operator: MAP[0] 2019-03-12T03:24:40,588 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: Id =0 null <\Children> <\Parent> <\MAP> 2019-03-12T03:24:40,588 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing Operator: TS[0] 2019-03-12T03:24:40,588 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[1] 2019-03-12T03:24:40,588 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT struct 2019-03-12T03:24:40,588 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Initializing Operator: GBY[2] 2019-03-12T03:24:40,593 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Max hash table memory: 954466304 bytes 2019-03-12T03:24:40,594 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: isTez: false isLlap: false numExecutors: 1 maxMemory: 1908932608 2019-03-12T03:24:40,594 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Initializing Operator: RS[3] 2019-03-12T03:24:40,594 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Using tag = -1 2019-03-12T03:24:40,607 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Stats Gathering found a new partition spec = i=3 2019-03-12T03:24:40,612 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: records read - 1 2019-03-12T03:24:40,612 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Closing Operator: MAP[0] 2019-03-12T03:24:40,612 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: Total records read - 1. abort - false 2019-03-12T03:24:40,612 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:1, RECORDS_OUT_OPERATOR_MAP_0:0, 2019-03-12T03:24:40,612 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Closing Operator: TS[0] 2019-03-12T03:24:40,613 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: publishing : default.simple_stats/i=3/ : {numRows=1, rawDataSize=0} 2019-03-12T03:24:40,617 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:1, 2019-03-12T03:24:40,617 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[1] 2019-03-12T03:24:40,617 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_SEL_1:1, 2019-03-12T03:24:40,618 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Closing Operator: GBY[2] 2019-03-12T03:24:40,618 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Begin Hash Table flush: size = 1 2019-03-12T03:24:40,619 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: keys are [_col0] num distributions: 1 2019-03-12T03:24:40,620 WARN [LocalJobRunner Map Task Executor #0] objectinspector.StandardStructObjectInspector: Trying to access 6 fields inside a list of 7 elements: [String, 5, 5, 1, 0, 48 4c 4c a0 01 01 c1 91 d7 9f 01, null] 2019-03-12T03:24:40,620 WARN [LocalJobRunner Map Task Executor #0] objectinspector.StandardStructObjectInspector: ignoring similar errors. 2019-03-12T03:24:40,620 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RS[3]: records written - 1 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: RECORDS_OUT_OPERATOR_GBY_2:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Closing Operator: RS[3] 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RS[3]: Total records written - 1. abort - false 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RECORDS_OUT_OPERATOR_RS_3:1, RECORDS_OUT_INTERMEDIATE:1, 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 43; bufvoid = 104857600 2019-03-12T03:24:40,621 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2019-03-12T03:24:40,652 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2019-03-12T03:24:40,657 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local829920451_0004_m_000000_0 is done. And is in the process of committing 2019-03-12T03:24:40,658 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: OrcSplit [file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=3/delta_0000003_0000003_0000/bucket_00000, start=3, length=296, isOriginal=false, fileLength=661, hasFooter=false, hasBase=true, deltas=0] 2019-03-12T03:24:40,658 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local829920451_0004_m_000000_0' done. 2019-03-12T03:24:40,658 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local829920451_0004_m_000000_0: Counters: 25 File System Counters FILE: Number of bytes read=41146 FILE: Number of bytes written=4451178 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Map input records=1 Map output records=1 Map output bytes=43 Map output materialized bytes=51 Input split bytes=497 Combine input records=0 Spilled Records=1 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=0 Total committed heap usage (bytes)=764936192 HIVE DESERIALIZE_ERRORS=0 RECORDS_IN=1 RECORDS_OUT_INTERMEDIATE=1 RECORDS_OUT_OPERATOR_GBY_2=1 RECORDS_OUT_OPERATOR_MAP_0=0 RECORDS_OUT_OPERATOR_RS_3=1 RECORDS_OUT_OPERATOR_SEL_1=1 RECORDS_OUT_OPERATOR_TS_0=1 File Input Format Counters Bytes Read=2063 2019-03-12T03:24:40,658 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local829920451_0004_m_000000_0 2019-03-12T03:24:40,658 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local829920451_0004_m_000001_0 2019-03-12T03:24:40,659 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2019-03-12T03:24:40,660 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: org.apache.hadoop.hive.ql.io.orc.OrcInputFormat:OrcSplit [file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=2/delta_0000002_0000002_0000/bucket_00000, start=3, length=296, isOriginal=false, fileLength=661, hasFooter=false, hasBase=true, deltas=0] 2019-03-12T03:24:40,660 INFO [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:40,663 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.88KB 2019-03-12T03:24:40,666 INFO [LocalJobRunner Map Task Executor #0] orc.OrcRawRecordMerger: min key = null, max key = null 2019-03-12T03:24:40,666 INFO [LocalJobRunner Map Task Executor #0] orc.ReaderImpl: Reading ORC rows from file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=2/delta_0000002_0000002_0000/bucket_00000 with {include: [true, true], offset: 3, length: 296, schema: struct, includeAcidColumns: true} 2019-03-12T03:24:40,667 INFO [LocalJobRunner Map Task Executor #0] orc.OrcRawRecordMerger: updated min key = null, max key = null 2019-03-12T03:24:40,667 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 1 2019-03-12T03:24:40,678 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2019-03-12T03:24:40,678 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2019-03-12T03:24:40,678 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2019-03-12T03:24:40,678 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2019-03-12T03:24:40,678 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2019-03-12T03:24:40,679 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2019-03-12T03:24:40,679 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: conf classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:40,679 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: thread classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:40,679 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Initializing Operator: MAP[0] 2019-03-12T03:24:40,681 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: Id =0 null <\Children> <\Parent> <\MAP> 2019-03-12T03:24:40,682 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing Operator: TS[0] 2019-03-12T03:24:40,682 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[1] 2019-03-12T03:24:40,682 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT struct 2019-03-12T03:24:40,682 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Initializing Operator: GBY[2] 2019-03-12T03:24:40,682 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Max hash table memory: 954466304 bytes 2019-03-12T03:24:40,682 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: isTez: false isLlap: false numExecutors: 1 maxMemory: 1908932608 2019-03-12T03:24:40,682 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Initializing Operator: RS[3] 2019-03-12T03:24:40,682 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Using tag = -1 2019-03-12T03:24:40,683 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Stats Gathering found a new partition spec = i=2 2019-03-12T03:24:40,683 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: records read - 1 2019-03-12T03:24:40,683 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Closing Operator: MAP[0] 2019-03-12T03:24:40,683 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: Total records read - 1. abort - false 2019-03-12T03:24:40,683 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:1, RECORDS_OUT_OPERATOR_MAP_0:0, 2019-03-12T03:24:40,683 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Closing Operator: TS[0] 2019-03-12T03:24:40,683 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: publishing : default.simple_stats/i=2/ : {numRows=1, rawDataSize=0} 2019-03-12T03:24:40,688 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:1, 2019-03-12T03:24:40,688 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[1] 2019-03-12T03:24:40,688 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_SEL_1:1, 2019-03-12T03:24:40,688 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Closing Operator: GBY[2] 2019-03-12T03:24:40,688 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Begin Hash Table flush: size = 1 2019-03-12T03:24:40,688 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: keys are [_col0] num distributions: 1 2019-03-12T03:24:40,688 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RS[3]: records written - 1 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: RECORDS_OUT_OPERATOR_GBY_2:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Closing Operator: RS[3] 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RS[3]: Total records written - 1. abort - false 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RECORDS_OUT_OPERATOR_RS_3:1, RECORDS_OUT_INTERMEDIATE:1, 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 43; bufvoid = 104857600 2019-03-12T03:24:40,689 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2019-03-12T03:24:40,696 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2019-03-12T03:24:40,699 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local829920451_0004_m_000001_0 is done. And is in the process of committing 2019-03-12T03:24:40,700 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: OrcSplit [file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=2/delta_0000002_0000002_0000/bucket_00000, start=3, length=296, isOriginal=false, fileLength=661, hasFooter=false, hasBase=true, deltas=0] 2019-03-12T03:24:40,700 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local829920451_0004_m_000001_0' done. 2019-03-12T03:24:40,700 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local829920451_0004_m_000001_0: Counters: 25 File System Counters FILE: Number of bytes read=50663 FILE: Number of bytes written=4451353 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Map input records=1 Map output records=1 Map output bytes=43 Map output materialized bytes=51 Input split bytes=497 Combine input records=0 Spilled Records=1 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=0 Total committed heap usage (bytes)=764936192 HIVE DESERIALIZE_ERRORS=0 RECORDS_IN=1 RECORDS_OUT_INTERMEDIATE=1 RECORDS_OUT_OPERATOR_GBY_2=1 RECORDS_OUT_OPERATOR_MAP_0=0 RECORDS_OUT_OPERATOR_RS_3=1 RECORDS_OUT_OPERATOR_SEL_1=1 RECORDS_OUT_OPERATOR_TS_0=1 File Input Format Counters Bytes Read=7999 2019-03-12T03:24:40,700 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local829920451_0004_m_000001_0 2019-03-12T03:24:40,700 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local829920451_0004_m_000002_0 2019-03-12T03:24:40,701 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2019-03-12T03:24:40,702 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: org.apache.hadoop.hive.ql.io.orc.OrcInputFormat:OrcSplit [file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=1/delta_0000001_0000001_0000/bucket_00000, start=3, length=293, isOriginal=false, fileLength=658, hasFooter=false, hasBase=true, deltas=0] 2019-03-12T03:24:40,702 INFO [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:40,704 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.88KB 2019-03-12T03:24:40,707 INFO [LocalJobRunner Map Task Executor #0] orc.OrcRawRecordMerger: min key = null, max key = null 2019-03-12T03:24:40,707 INFO [LocalJobRunner Map Task Executor #0] orc.ReaderImpl: Reading ORC rows from file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=1/delta_0000001_0000001_0000/bucket_00000 with {include: [true, true], offset: 3, length: 293, schema: struct, includeAcidColumns: true} 2019-03-12T03:24:40,707 INFO [LocalJobRunner Map Task Executor #0] orc.OrcRawRecordMerger: updated min key = null, max key = null 2019-03-12T03:24:40,708 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 1 2019-03-12T03:24:40,773 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 2019-03-12T03:24:40,773 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: mapreduce.task.io.sort.mb: 100 2019-03-12T03:24:40,773 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: soft limit at 83886080 2019-03-12T03:24:40,773 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufvoid = 104857600 2019-03-12T03:24:40,773 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396; length = 6553600 2019-03-12T03:24:40,774 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 2019-03-12T03:24:40,774 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: conf classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:40,774 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: thread classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:40,774 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Initializing Operator: MAP[0] 2019-03-12T03:24:40,775 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: Id =0 null <\Children> <\Parent> <\MAP> 2019-03-12T03:24:40,776 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing Operator: TS[0] 2019-03-12T03:24:40,776 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[1] 2019-03-12T03:24:40,776 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT struct 2019-03-12T03:24:40,776 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Initializing Operator: GBY[2] 2019-03-12T03:24:40,776 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Max hash table memory: 954466304 bytes 2019-03-12T03:24:40,776 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: isTez: false isLlap: false numExecutors: 1 maxMemory: 1908932608 2019-03-12T03:24:40,776 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Initializing Operator: RS[3] 2019-03-12T03:24:40,776 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Using tag = -1 2019-03-12T03:24:40,777 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Stats Gathering found a new partition spec = i=1 2019-03-12T03:24:40,777 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: records read - 1 2019-03-12T03:24:40,777 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Closing Operator: MAP[0] 2019-03-12T03:24:40,777 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: Total records read - 1. abort - false 2019-03-12T03:24:40,777 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:1, RECORDS_OUT_OPERATOR_MAP_0:0, 2019-03-12T03:24:40,777 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Closing Operator: TS[0] 2019-03-12T03:24:40,777 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: publishing : default.simple_stats/i=1/ : {numRows=1, rawDataSize=0} 2019-03-12T03:24:40,781 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:1, 2019-03-12T03:24:40,781 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[1] 2019-03-12T03:24:40,781 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_SEL_1:1, 2019-03-12T03:24:40,781 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Closing Operator: GBY[2] 2019-03-12T03:24:40,781 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: Begin Hash Table flush: size = 1 2019-03-12T03:24:40,781 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: keys are [_col0] num distributions: 1 2019-03-12T03:24:40,782 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RS[3]: records written - 1 2019-03-12T03:24:40,782 INFO [LocalJobRunner Map Task Executor #0] exec.GroupByOperator: RECORDS_OUT_OPERATOR_GBY_2:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:40,782 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: Closing Operator: RS[3] 2019-03-12T03:24:40,782 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RS[3]: Total records written - 1. abort - false 2019-03-12T03:24:40,782 INFO [LocalJobRunner Map Task Executor #0] exec.ReduceSinkOperator: RECORDS_OUT_OPERATOR_RS_3:1, RECORDS_OUT_INTERMEDIATE:1, 2019-03-12T03:24:40,783 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2019-03-12T03:24:40,783 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Starting flush of map output 2019-03-12T03:24:40,783 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Spilling map output 2019-03-12T03:24:40,783 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: bufstart = 0; bufend = 43; bufvoid = 104857600 2019-03-12T03:24:40,783 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600 2019-03-12T03:24:40,789 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Finished spill 0 2019-03-12T03:24:40,793 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local829920451_0004_m_000002_0 is done. And is in the process of committing 2019-03-12T03:24:40,794 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: OrcSplit [file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=1/delta_0000001_0000001_0000/bucket_00000, start=3, length=293, isOriginal=false, fileLength=658, hasFooter=false, hasBase=true, deltas=0] 2019-03-12T03:24:40,794 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local829920451_0004_m_000002_0' done. 2019-03-12T03:24:40,794 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local829920451_0004_m_000002_0: Counters: 25 File System Counters FILE: Number of bytes read=59659 FILE: Number of bytes written=4451528 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Map input records=1 Map output records=1 Map output bytes=43 Map output materialized bytes=51 Input split bytes=497 Combine input records=0 Spilled Records=1 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=59 Total committed heap usage (bytes)=774897664 HIVE DESERIALIZE_ERRORS=0 RECORDS_IN=1 RECORDS_OUT_INTERMEDIATE=1 RECORDS_OUT_OPERATOR_GBY_2=1 RECORDS_OUT_OPERATOR_MAP_0=0 RECORDS_OUT_OPERATOR_RS_3=1 RECORDS_OUT_OPERATOR_SEL_1=1 RECORDS_OUT_OPERATOR_TS_0=1 File Input Format Counters Bytes Read=7990 2019-03-12T03:24:40,794 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local829920451_0004_m_000002_0 2019-03-12T03:24:40,794 INFO [Thread-238] mapred.LocalJobRunner: map task executor complete. 2019-03-12T03:24:40,797 INFO [Thread-238] mapred.LocalJobRunner: Waiting for reduce tasks 2019-03-12T03:24:40,797 INFO [pool-21-thread-1] mapred.LocalJobRunner: Starting task: attempt_local829920451_0004_r_000000_0 2019-03-12T03:24:40,804 INFO [pool-21-thread-1] mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2019-03-12T03:24:40,807 INFO [pool-21-thread-1] mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@580f5de5 2019-03-12T03:24:40,808 WARN [pool-21-thread-1] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:40,824 INFO [pool-21-thread-1] reduce.MergeManagerImpl: MergerManager: memoryLimit=1336252800, maxSingleShuffleLimit=334063200, mergeThreshold=881926912, ioSortFactor=10, memToMemMergeOutputsThreshold=10 2019-03-12T03:24:40,831 INFO [EventFetcher for fetching Map Completion Events] reduce.EventFetcher: attempt_local829920451_0004_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events 2019-03-12T03:24:40,875 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local829920451_0004_m_000001_0 decomp: 47 len: 51 to MEMORY 2019-03-12T03:24:40,880 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 47 bytes from map-output for attempt_local829920451_0004_m_000001_0 2019-03-12T03:24:40,884 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 47, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->47 2019-03-12T03:24:40,888 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local829920451_0004_m_000002_0 decomp: 47 len: 51 to MEMORY 2019-03-12T03:24:40,888 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 47 bytes from map-output for attempt_local829920451_0004_m_000002_0 2019-03-12T03:24:40,889 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 47, inMemoryMapOutputs.size() -> 2, commitMemory -> 47, usedMemory ->94 2019-03-12T03:24:40,892 INFO [localfetcher#1] reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local829920451_0004_m_000000_0 decomp: 47 len: 51 to MEMORY 2019-03-12T03:24:40,892 INFO [localfetcher#1] reduce.InMemoryMapOutput: Read 47 bytes from map-output for attempt_local829920451_0004_m_000000_0 2019-03-12T03:24:40,892 INFO [localfetcher#1] reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 47, inMemoryMapOutputs.size() -> 3, commitMemory -> 94, usedMemory ->141 2019-03-12T03:24:40,893 INFO [EventFetcher for fetching Map Completion Events] reduce.EventFetcher: EventFetcher is interrupted.. Returning 2019-03-12T03:24:40,895 INFO [pool-21-thread-1] mapred.LocalJobRunner: 3 / 3 copied. 2019-03-12T03:24:40,896 INFO [pool-21-thread-1] reduce.MergeManagerImpl: finalMerge called with 3 in-memory map-outputs and 0 on-disk map-outputs 2019-03-12T03:24:40,912 INFO [pool-21-thread-1] mapred.Merger: Merging 3 sorted segments 2019-03-12T03:24:40,913 INFO [pool-21-thread-1] mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 105 bytes 2019-03-12T03:24:40,916 INFO [pool-21-thread-1] reduce.MergeManagerImpl: Merged 3 segments, 141 bytes to disk to satisfy reduce memory limit 2019-03-12T03:24:40,917 INFO [pool-21-thread-1] reduce.MergeManagerImpl: Merging 1 files, 141 bytes from disk 2019-03-12T03:24:40,918 INFO [pool-21-thread-1] reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce 2019-03-12T03:24:40,918 INFO [pool-21-thread-1] mapred.Merger: Merging 1 sorted segments 2019-03-12T03:24:40,918 INFO [pool-21-thread-1] mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 125 bytes 2019-03-12T03:24:40,918 INFO [pool-21-thread-1] mapred.LocalJobRunner: 3 / 3 copied. 2019-03-12T03:24:40,921 INFO [pool-21-thread-1] ExecReducer: conf classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:40,921 INFO [pool-21-thread-1] ExecReducer: thread classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:40,922 INFO [pool-21-thread-1] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2019-03-12T03:24:40,929 INFO [pool-21-thread-1] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.43KB 2019-03-12T03:24:40,930 INFO [pool-21-thread-1] ExecReducer: Id =4 Id =5 Id =6 <\Children> Id = 5 null<\Parent> <\FS> <\Children> Id = 4 null<\Parent> <\SEL> <\Children> <\Parent> <\GBY> 2019-03-12T03:24:40,930 INFO [pool-21-thread-1] exec.GroupByOperator: Initializing Operator: GBY[4] 2019-03-12T03:24:40,931 INFO [pool-21-thread-1] exec.GroupByOperator: isTez: false isLlap: false numExecutors: 1 maxMemory: 1908932608 2019-03-12T03:24:40,931 INFO [pool-21-thread-1] exec.SelectOperator: Initializing Operator: SEL[5] 2019-03-12T03:24:40,931 INFO [pool-21-thread-1] exec.SelectOperator: SELECT struct<_col0:int,_col1:struct> 2019-03-12T03:24:40,931 INFO [pool-21-thread-1] exec.FileSinkOperator: Initializing Operator: FS[6] 2019-03-12T03:24:40,932 INFO [pool-21-thread-1] exec.FileSinkOperator: Using serializer : class org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe[[[B@6d32f457]:[_col0, _col1]:[struct, int]] and formatter : org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat@1668baf6 2019-03-12T03:24:40,939 INFO [pool-21-thread-1] exec.FileSinkOperator: Final Path: FS file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-39_990_7460911005596272972-1/-mr-10000/.hive-staging_hive_2019-03-12_03-24-39_990_7460911005596272972-1/_tmp.-ext-10002/000000_0 2019-03-12T03:24:40,939 INFO [pool-21-thread-1] exec.FileSinkOperator: Writing to temp file: FS file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-39_990_7460911005596272972-1/-mr-10000/.hive-staging_hive_2019-03-12_03-24-39_990_7460911005596272972-1/_task_tmp.-ext-10002/_tmp.000000_0 2019-03-12T03:24:40,939 INFO [pool-21-thread-1] exec.FileSinkOperator: New Final Path: FS file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-39_990_7460911005596272972-1/-mr-10000/.hive-staging_hive_2019-03-12_03-24-39_990_7460911005596272972-1/_tmp.-ext-10002/000000_0 2019-03-12T03:24:40,966 INFO [pool-21-thread-1] exec.FileSinkOperator: FS[6]: records written - 1 2019-03-12T03:24:40,967 INFO [pool-21-thread-1] exec.GroupByOperator: Closing Operator: GBY[4] 2019-03-12T03:24:40,967 INFO [pool-21-thread-1] exec.GroupByOperator: RECORDS_OUT_OPERATOR_GBY_4:3, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:40,967 INFO [pool-21-thread-1] exec.SelectOperator: Closing Operator: SEL[5] 2019-03-12T03:24:40,967 INFO [pool-21-thread-1] exec.SelectOperator: RECORDS_OUT_OPERATOR_SEL_5:3, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:40,968 INFO [pool-21-thread-1] exec.FileSinkOperator: Closing Operator: FS[6] 2019-03-12T03:24:40,968 INFO [pool-21-thread-1] exec.FileSinkOperator: FS[6]: records written - 3 2019-03-12T03:24:40,968 INFO [pool-21-thread-1] exec.FileSinkOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_FS_6:3, RECORDS_OUT_0:3, 2019-03-12T03:24:40,969 INFO [pool-21-thread-1] mapred.Task: Task:attempt_local829920451_0004_r_000000_0 is done. And is in the process of committing 2019-03-12T03:24:40,969 INFO [pool-21-thread-1] mapred.LocalJobRunner: reduce > reduce 2019-03-12T03:24:40,969 INFO [pool-21-thread-1] mapred.Task: Task 'attempt_local829920451_0004_r_000000_0' done. 2019-03-12T03:24:40,970 INFO [pool-21-thread-1] mapred.Task: Final Counters for attempt_local829920451_0004_r_000000_0: Counters: 30 File System Counters FILE: Number of bytes read=65531 FILE: Number of bytes written=4451928 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Combine input records=0 Combine output records=0 Reduce input groups=3 Reduce shuffle bytes=153 Reduce input records=3 Reduce output records=0 Spilled Records=3 Shuffled Maps =3 Failed Shuffles=0 Merged Map outputs=3 GC time elapsed (ms)=0 Total committed heap usage (bytes)=774897664 HIVE CREATED_FILES=1 RECORDS_OUT_0=3 RECORDS_OUT_INTERMEDIATE=0 RECORDS_OUT_OPERATOR_FS_6=3 RECORDS_OUT_OPERATOR_GBY_4=3 RECORDS_OUT_OPERATOR_SEL_5=3 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Output Format Counters Bytes Written=0 2019-03-12T03:24:40,970 INFO [pool-21-thread-1] mapred.LocalJobRunner: Finishing task: attempt_local829920451_0004_r_000000_0 2019-03-12T03:24:40,970 INFO [Thread-238] mapred.LocalJobRunner: reduce task executor complete. 2019-03-12 03:24:41,534 Stage-0 map = 100%, reduce = 100% 2019-03-12T03:24:41,534 INFO [main] exec.Task: 2019-03-12 03:24:41,534 Stage-0 map = 100%, reduce = 100% Ended Job = job_local829920451_0004 2019-03-12T03:24:41,536 INFO [main] exec.Task: Ended Job = job_local829920451_0004 2019-03-12T03:24:41,551 INFO [main] ql.Driver: Starting task [Stage-1:STATS] in serial mode 2019-03-12T03:24:41,551 INFO [main] stats.BasicStatsTask: Executing stats task 2019-03-12T03:24:41,552 INFO [main] fs.FSStatsPublisher: created : file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-39_990_7460911005596272972-1/-mr-10001 2019-03-12T03:24:41,569 WARN [stats-updater-thread-0] FileOperations: Computing stats for an ACID table; stats may be inaccurate 2019-03-12T03:24:41,571 WARN [stats-updater-thread-1] FileOperations: Computing stats for an ACID table; stats may be inaccurate 2019-03-12T03:24:41,576 WARN [stats-updater-thread-2] FileOperations: Computing stats for an ACID table; stats may be inaccurate 2019-03-12T03:24:41,595 INFO [main] FileOperations: Read stats for default.simple_stats/i=1/, numRows, 1: 2019-03-12T03:24:41,596 INFO [main] FileOperations: Read stats for default.simple_stats/i=1/, rawDataSize, 0: 2019-03-12T03:24:41,596 INFO [main] stats.BasicStatsTask: Partition {i=1} stats: [numFiles=1, numRows=1, totalSize=658, rawDataSize=0, numFilesErasureCoded=0] 2019-03-12T03:24:41,596 INFO [main] FileOperations: Read stats for default.simple_stats/i=2/, numRows, 1: 2019-03-12T03:24:41,596 INFO [main] FileOperations: Read stats for default.simple_stats/i=2/, rawDataSize, 0: 2019-03-12T03:24:41,596 INFO [main] stats.BasicStatsTask: Partition {i=2} stats: [numFiles=1, numRows=1, totalSize=661, rawDataSize=0, numFilesErasureCoded=0] 2019-03-12T03:24:41,596 INFO [main] FileOperations: Read stats for default.simple_stats/i=3/, numRows, 1: 2019-03-12T03:24:41,596 INFO [main] FileOperations: Read stats for default.simple_stats/i=3/, rawDataSize, 0: 2019-03-12T03:24:41,596 INFO [main] stats.BasicStatsTask: Partition {i=3} stats: [numFiles=1, numRows=1, totalSize=661, rawDataSize=0, numFilesErasureCoded=0] 2019-03-12T03:24:41,597 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=alter_partitions : tbl=hive.default.simple_stats 2019-03-12T03:24:41,597 INFO [main] metastore.HiveMetaStore: New partition values:[1] 2019-03-12T03:24:41,597 INFO [main] metastore.HiveMetaStore: New partition values:[2] 2019-03-12T03:24:41,597 INFO [main] metastore.HiveMetaStore: New partition values:[3] 2019-03-12T03:24:41,693 INFO [main] mapred.FileInputFormat: Total input files to process : 1 2019-03-12T03:24:41,746 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=write_partition_column_statistics: db=default table=simple_stats part=i=1 2019-03-12T03:24:41,765 INFO [main] metastore.ObjectStore: Updating partition level column statistics for table=hive.default.simple_stats partName=i=1 colName=s 2019-03-12T03:24:41,784 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=write_partition_column_statistics: db=default table=simple_stats part=i=3 2019-03-12T03:24:41,797 INFO [main] metastore.ObjectStore: Updating partition level column statistics for table=hive.default.simple_stats partName=i=3 colName=s 2019-03-12T03:24:41,803 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=write_partition_column_statistics: db=default table=simple_stats part=i=2 2019-03-12T03:24:41,816 INFO [main] metastore.ObjectStore: Updating partition level column statistics for table=hive.default.simple_stats partName=i=2 colName=s 2019-03-12T03:24:41,821 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase MapReduce Jobs Launched: 2019-03-12T03:24:41,821 INFO [main] ql.Driver: MapReduce Jobs Launched: Stage-Stage-0: HDFS Read: 0 HDFS Write: 0 SUCCESS 2019-03-12T03:24:41,821 INFO [main] ql.Driver: Stage-Stage-0: HDFS Read: 0 HDFS Write: 0 SUCCESS Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:41,822 INFO [main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:41,822 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483); Time taken: 1.543 seconds 2019-03-12T03:24:41,822 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032439_72fffbf3-b03f-4033-a8e4-4c2a5b0fc483 2019-03-12T03:24:41,828 INFO [main] txn.TxnHandler: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:8 2019-03-12T03:24:41,839 INFO [main] txn.TxnHandler: Removed committed transaction: (8) from MIN_HISTORY_LEVEL 2019-03-12T03:24:41,850 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partition_by_name: tbl=hive.default.simple_stats part=i=1 2019-03-12T03:24:41,876 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partition_by_name: tbl=hive.default.simple_stats part=i=2 2019-03-12T03:24:41,898 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e): insert into simple_stats (i, s) values (1, 'test12') 2019-03-12T03:24:41,905 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([9]) with min_open_txn: 9 2019-03-12T03:24:41,906 INFO [main] lockmgr.DbTxnManager: Opened txnid:9 2019-03-12T03:24:41,909 INFO [main] parse.CalcitePlanner: Starting Semantic Analysis 2019-03-12T03:24:41,909 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:41,916 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:41,922 INFO [main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis 2019-03-12T03:24:41,922 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:41,922 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:41,922 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:41,923 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:41,929 INFO [main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis 2019-03-12T03:24:41,940 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:41,948 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:41,955 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:41,956 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:41,961 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=_dummy_database foreigntbl=_dummy_table 2019-03-12T03:24:41,976 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_databases: @hive# 2019-03-12T03:24:41,979 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_materialized_views_for_rewriting: db=@hive#default 2019-03-12T03:24:41,988 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:41,994 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:41,994 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:41,994 INFO [main] parse.CalcitePlanner: Get metadata for source tables 2019-03-12T03:24:41,995 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive._dummy_database._dummy_table 2019-03-12T03:24:41,996 INFO [main] parse.CalcitePlanner: Get metadata for subqueries 2019-03-12T03:24:41,996 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:41,996 INFO [main] parse.CalcitePlanner: Get metadata for destination tables 2019-03-12T03:24:41,996 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:42,008 INFO [main] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1 2019-03-12T03:24:42,011 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.simple_stats 2019-03-12T03:24:42,013 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_check_constraints : tbl=hive.default.simple_stats 2019-03-12T03:24:42,028 INFO [main] txn.TxnHandler: Allocated writeID: 5 for txnId: 9 2019-03-12T03:24:42,034 INFO [main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan. 2019-03-12T03:24:42,035 INFO [main] ppd.OpProcFactory: Processing for FS(4) 2019-03-12T03:24:42,035 INFO [main] ppd.OpProcFactory: Processing for SEL(3) 2019-03-12T03:24:42,035 INFO [main] ppd.OpProcFactory: Processing for UDTF(2) 2019-03-12T03:24:42,035 INFO [main] ppd.OpProcFactory: Processing for SEL(1) 2019-03-12T03:24:42,035 INFO [main] ppd.OpProcFactory: Processing for TS(0) 2019-03-12T03:24:42,037 INFO [main] correlation.AbstractCorrelationProcCtx: Overriding hive.optimize.reducededuplication.min.reducer to 1 due to a write to transactional table(s) default.simple_stats 2019-03-12T03:24:42,052 INFO [main] physical.Vectorizer: Examining input format to see if vectorization is enabled. 2019-03-12T03:24:42,053 INFO [main] physical.Vectorizer: Map vectorization enabled: false 2019-03-12T03:24:42,053 INFO [main] physical.Vectorizer: Map vectorized: false 2019-03-12T03:24:42,053 INFO [main] physical.Vectorizer: Map vectorizedVertexNum: 0 2019-03-12T03:24:42,053 INFO [main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vectorized.input.format IS true] 2019-03-12T03:24:42,053 INFO [main] physical.Vectorizer: Map enabledConditionsNotMet: [Could not enable vectorization due to partition column names size 1 is greater than the number of table column names size 0 IS false] 2019-03-12T03:24:42,053 INFO [main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.hive.ql.io.NullRowsInputFormat] 2019-03-12T03:24:42,053 INFO [main] parse.CalcitePlanner: Completed plan generation 2019-03-12T03:24:42,054 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:42,054 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:string, comment:null), FieldSchema(name:_col1, type:int, comment:null)], properties:null) 2019-03-12T03:24:42,054 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:42,054 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e); Time taken: 0.157 seconds 2019-03-12T03:24:42,054 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:9 for queryId=abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e 2019-03-12T03:24:42,055 INFO [main] lockmgr.DbLockManager: Requesting: queryId=abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e LockRequest(component:[LockComponent(type:SHARED_READ, level:TABLE, dbname:_dummy_database, tablename:_dummy_table, operationType:SELECT, isTransactional:false), LockComponent(type:SHARED_READ, level:TABLE, dbname:default, tablename:simple_stats, operationType:INSERT, isTransactional:true, isDynamicPartitionWrite:true)], txnid:9, user:abapat, hostname:ubuntu, agentInfo:abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e) 2019-03-12T03:24:42,073 INFO [main] lockmgr.DbLockManager: Response to queryId=abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e LockResponse(lockid:6, state:ACQUIRED) 2019-03-12T03:24:42,073 INFO [main] ql.Driver: Operation QUERY obtained 1 locks 2019-03-12T03:24:42,080 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e): insert into simple_stats (i, s) values (1, 'test12') 2019-03-12T03:24:42,081 WARN [main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. Query ID = abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e 2019-03-12T03:24:42,081 INFO [main] ql.Driver: Query ID = abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e Total jobs = 1 2019-03-12T03:24:42,081 INFO [main] ql.Driver: Total jobs = 1 Launching Job 1 out of 1 2019-03-12T03:24:42,081 INFO [main] ql.Driver: Launching Job 1 out of 1 2019-03-12T03:24:42,083 INFO [main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode Number of reduce tasks is set to 0 since there's no reduce operator 2019-03-12T03:24:42,083 INFO [main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator 2019-03-12T03:24:42,085 INFO [main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.HiveInputFormat 2019-03-12T03:24:42,085 INFO [main] exec.Utilities: Processing alias $hdt$_0:_dummy_table 2019-03-12T03:24:42,085 INFO [main] exec.Utilities: Adding 1 inputs; the first input is file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-41_898_8984017731444515965-1/dummy_path 2019-03-12T03:24:42,095 INFO [main] exec.SerializationUtilities: Serializing MapWork using kryo 2019-03-12T03:24:42,097 INFO [main] exec.Utilities: Serialized plan (via FILE) - name: null size: 5.43KB 2019-03-12T03:24:42,098 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:42,102 WARN [main] impl.MetricsSystemImpl: JobTracker metrics system already initialized! 2019-03-12T03:24:42,108 WARN [main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2019-03-12T03:24:42,113 WARN [main] mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2019-03-12T03:24:42,113 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.ids = 2019-03-12T03:24:42,113 INFO [main] io.HiveInputFormat: hive.io.file.readcolumn.names = 2019-03-12T03:24:42,114 INFO [main] io.HiveInputFormat: Generating splits for dirs: file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-41_898_8984017731444515965-1/dummy_path 2019-03-12T03:24:42,114 INFO [main] io.HiveInputFormat: number of splits 1 2019-03-12T03:24:42,130 INFO [main] mapreduce.JobSubmitter: number of splits:1 2019-03-12T03:24:42,148 INFO [main] mapreduce.JobSubmitter: Submitting tokens for job: job_local1029275752_0005 2019-03-12T03:24:42,148 INFO [main] mapreduce.JobSubmitter: Executing with tokens: [] 2019-03-12T03:24:42,224 INFO [main] mapreduce.Job: The url to track the job: http://localhost:8080/ Job running in-process (local Hadoop) 2019-03-12T03:24:42,224 INFO [main] exec.Task: Job running in-process (local Hadoop) 2019-03-12T03:24:42,225 INFO [Thread-305] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:42,225 INFO [Thread-305] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2019-03-12T03:24:42,227 INFO [Thread-305] mapred.LocalJobRunner: Waiting for map tasks 2019-03-12T03:24:42,227 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local1029275752_0005_m_000000_0 2019-03-12T03:24:42,229 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ] 2019-03-12T03:24:42,230 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: org.apache.hadoop.hive.ql.io.NullRowsInputFormat:file:/work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9/hive_2019-03-12_03-24-41_898_8984017731444515965-1/dummy_path/null:0+1 2019-03-12T03:24:42,230 INFO [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo 2019-03-12T03:24:42,233 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 5.43KB 2019-03-12T03:24:42,233 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 0 2019-03-12T03:24:42,233 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: conf classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:42,233 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: thread classpath = [file:/work/hive21109/cr/ql/target/surefire/surefirebooter298002814050026278.jar] 2019-03-12T03:24:42,233 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Initializing Operator: MAP[0] 2019-03-12T03:24:42,234 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: Id =0 null <\Children> <\Parent> <\MAP> 2019-03-12T03:24:42,234 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing Operator: TS[0] 2019-03-12T03:24:42,235 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[1] 2019-03-12T03:24:42,235 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT null 2019-03-12T03:24:42,235 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: Initializing Operator: UDTF[2] 2019-03-12T03:24:42,235 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Initializing Operator: SEL[3] 2019-03-12T03:24:42,235 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: SELECT struct 2019-03-12T03:24:42,235 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Initializing Operator: FS[4] 2019-03-12T03:24:42,236 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.ql.io.orc.OrcSerde@60e6b057 and formatter : org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat@5581a60b 2019-03-12T03:24:42,236 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Final Path: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/_tmp.-ext-10000/i=1/000000_0 2019-03-12T03:24:42,236 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Writing to temp file: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/_task_tmp.-ext-10000/i=1/_tmp.000000_0 2019-03-12T03:24:42,236 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: New Final Path: FS file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/_tmp.-ext-10000/i=1/000000_0 2019-03-12T03:24:42,237 INFO [LocalJobRunner Map Task Executor #0] impl.MemoryManagerImpl: orc.rows.between.memory.checks=5000 2019-03-12T03:24:42,237 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1 2019-03-12T03:24:42,237 INFO [LocalJobRunner Map Task Executor #0] impl.PhysicalFsWriter: ORC writer created for path: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/_task_tmp.-ext-10000/i=1/_tmp.000000_0/delta_0000005_0000005_0000/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768 2019-03-12T03:24:42,252 INFO [LocalJobRunner Map Task Executor #0] impl.WriterImpl: ORC writer created for path: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/_task_tmp.-ext-10000/i=1/_tmp.000000_0/delta_0000005_0000005_0000/bucket_00000 with stripeSize: 8388608 blockSize: 268435456 compression: ZLIB bufferSize: 32768 2019-03-12T03:24:42,256 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: records read - 1 2019-03-12T03:24:42,256 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: Closing Operator: MAP[0] 2019-03-12T03:24:42,256 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: MAP[0]: Total records read - 3. abort - false 2019-03-12T03:24:42,256 INFO [LocalJobRunner Map Task Executor #0] exec.MapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:3, RECORDS_OUT_OPERATOR_MAP_0:0, 2019-03-12T03:24:42,256 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Closing Operator: TS[0] 2019-03-12T03:24:42,256 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:1, 2019-03-12T03:24:42,257 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[1] 2019-03-12T03:24:42,257 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_SEL_1:1, 2019-03-12T03:24:42,257 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: Closing Operator: UDTF[2] 2019-03-12T03:24:42,257 INFO [LocalJobRunner Map Task Executor #0] exec.UDTFOperator: RECORDS_OUT_OPERATOR_UDTF_2:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:42,257 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: Closing Operator: SEL[3] 2019-03-12T03:24:42,257 INFO [LocalJobRunner Map Task Executor #0] exec.SelectOperator: RECORDS_OUT_OPERATOR_SEL_3:1, RECORDS_OUT_INTERMEDIATE:0, 2019-03-12T03:24:42,257 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Closing Operator: FS[4] 2019-03-12T03:24:42,257 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1 2019-03-12T03:24:42,259 INFO [LocalJobRunner Map Task Executor #0] common.FileUtils: Creating directory if it doesn't exist: file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/_tmp.-ext-10000/i=1 2019-03-12T03:24:42,262 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: RECORDS_OUT_1_default.simple_stats:1, RECORDS_OUT_OPERATOR_FS_4:1, RECORDS_OUT_INTERMEDIATE:0, TOTAL_TABLE_ROWS_WRITTEN:1, 2019-03-12T03:24:42,263 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: 2019-03-12T03:24:42,263 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local1029275752_0005_m_000000_0 is done. And is in the process of committing 2019-03-12T03:24:42,264 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: map 2019-03-12T03:24:42,264 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local1029275752_0005_m_000000_0' done. 2019-03-12T03:24:42,264 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1029275752_0005_m_000000_0: Counters: 27 File System Counters FILE: Number of bytes read=71959 FILE: Number of bytes written=5566392 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 Map-Reduce Framework Map input records=4 Map output records=0 Input split bytes=351 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=0 Total committed heap usage (bytes)=774897664 HIVE CREATED_FILES=1 DESERIALIZE_ERRORS=0 RECORDS_IN=3 RECORDS_OUT_1_default.simple_stats=1 RECORDS_OUT_INTERMEDIATE=0 RECORDS_OUT_OPERATOR_FS_4=1 RECORDS_OUT_OPERATOR_MAP_0=0 RECORDS_OUT_OPERATOR_SEL_1=1 RECORDS_OUT_OPERATOR_SEL_3=1 RECORDS_OUT_OPERATOR_TS_0=1 RECORDS_OUT_OPERATOR_UDTF_2=1 TOTAL_TABLE_ROWS_WRITTEN=1 File Input Format Counters Bytes Read=5486 File Output Format Counters Bytes Written=0 2019-03-12T03:24:42,264 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local1029275752_0005_m_000000_0 2019-03-12T03:24:42,264 INFO [Thread-305] mapred.LocalJobRunner: map task executor complete. 2019-03-12 03:24:43,227 Stage-1 map = 100%, reduce = 0% 2019-03-12T03:24:43,227 INFO [main] exec.Task: 2019-03-12 03:24:43,227 Stage-1 map = 100%, reduce = 0% Ended Job = job_local1029275752_0005 2019-03-12T03:24:43,228 INFO [main] exec.Task: Ended Job = job_local1029275752_0005 2019-03-12T03:24:43,230 INFO [main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode Loading data to table default.simple_stats partition (i=null) 2019-03-12T03:24:43,231 INFO [main] exec.Task: Loading data to table default.simple_stats partition (i=null) from file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/-ext-10000 2019-03-12T03:24:43,231 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:43,240 INFO [main] exec.MoveTask: Partition is: {i=null} 2019-03-12T03:24:43,241 INFO [main] exec.Task: 2019-03-12T03:24:43,242 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:43,253 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:43,261 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_names_ps : tbl=hive.default.simple_stats[] 2019-03-12T03:24:43,282 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_partitions_by_names : tbl=hive.default.simple_stats 2019-03-12T03:24:43,322 INFO [load-dynamic-partitionsToAdd-0] metadata.Hive: New loading path = file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/-ext-10000/i=1 withPartSpec {i=1} 2019-03-12T03:24:43,326 INFO [load-dynamic-partitionsToAdd-0] metadata.Hive: Moving bucket file:///work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/.hive-staging_hive_2019-03-12_03-24-41_898_8984017731444515965-1/-ext-10000/i=1/000000_0/delta_0000005_0000005_0000/bucket_00000 to file:/work/hive21109/cr/ql/target/tmp/org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-1552386263485/simple_stats/i=1/delta_0000005_0000005_0000/bucket_00000 2019-03-12T03:24:43,328 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=alter_partitions : tbl=hive.default.simple_stats 2019-03-12T03:24:43,329 INFO [main] metastore.HiveMetaStore: New partition values:[1] 2019-03-12T03:24:43,346 ERROR [main] metastore.ObjectStore: Alter failed org.apache.hadoop.hive.metastore.api.MetaException: Cannot change stats state for a transactional table default.simple_stats without providing the transactional write state for verification (new write ID 5, valid write IDs null; current state {"BASIC_STATS":"true","COLUMN_STATS":{"s":"true"}}; new state null at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:4328) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitions(ObjectStore.java:4414) [hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) [hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy34.alterPartitions(Unknown Source) [?:?] at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterPartitions(HiveAlterHandler.java:734) [hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_with_environment_context(HiveMetaStore.java:5156) [hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_req(HiveMetaStore.java:5108) [hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) [hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) [hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy36.alter_partitions_req(Unknown Source) [?:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_partitions(HiveMetaStoreClient.java:2222) [hive-standalone-metastore-common-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) [hive-standalone-metastore-common-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy37.alter_partitions(Unknown Source) [?:?] at org.apache.hadoop.hive.metastore.SynchronizedMetaStoreClient.alter_partitions(SynchronizedMetaStoreClient.java:95) [classes/:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.ql.metadata.Hive.setStatsPropAndAlterPartitions(Hive.java:2386) [classes/:?] at org.apache.hadoop.hive.ql.metadata.Hive.loadDynamicPartitions(Hive.java:2727) [classes/:?] at org.apache.hadoop.hive.ql.exec.MoveTask.handleDynParts(MoveTask.java:560) [classes/:?] at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) [classes/:?] at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) [classes/:?] at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) [classes/:?] at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2709) [classes/:?] at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2361) [classes/:?] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2028) [classes/:?] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1788) [classes/:?] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1777) [classes/:?] at org.apache.hadoop.hive.ql.DriverUtils.runOnDriver(DriverUtils.java:54) [classes/:?] at org.apache.hadoop.hive.ql.DriverUtils.runOnDriver(DriverUtils.java:34) [classes/:?] at org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread.executeQuery(TestStatsUpdaterThread.java:644) [test-classes/:?] at org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread.testTxnDynamicPartitions(TestStatsUpdaterThread.java:309) [test-classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:?] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:?] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:?] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:?] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:?] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:?] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:?] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:?] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:?] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:?] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:?] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:?] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:?] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:?] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:?] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) [surefire-booter-2.21.0.jar:2.21.0] 2019-03-12T03:24:43,351 ERROR [main] metastore.RetryingHMSHandler: MetaException(message:The transaction for alter partition did not commit successfully.) at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitions(ObjectStore.java:4432) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) at com.sun.proxy.$Proxy34.alterPartitions(Unknown Source) at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterPartitions(HiveAlterHandler.java:734) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_with_environment_context(HiveMetaStore.java:5156) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_req(HiveMetaStore.java:5108) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) at com.sun.proxy.$Proxy36.alter_partitions_req(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_partitions(HiveMetaStoreClient.java:2222) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) at com.sun.proxy.$Proxy37.alter_partitions(Unknown Source) at org.apache.hadoop.hive.metastore.SynchronizedMetaStoreClient.alter_partitions(SynchronizedMetaStoreClient.java:95) at org.apache.hadoop.hive.ql.metadata.Hive.setStatsPropAndAlterPartitions(Hive.java:2386) at org.apache.hadoop.hive.ql.metadata.Hive.loadDynamicPartitions(Hive.java:2727) at org.apache.hadoop.hive.ql.exec.MoveTask.handleDynParts(MoveTask.java:560) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2709) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2361) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2028) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1788) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1777) at org.apache.hadoop.hive.ql.DriverUtils.runOnDriver(DriverUtils.java:54) at org.apache.hadoop.hive.ql.DriverUtils.runOnDriver(DriverUtils.java:34) at org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread.executeQuery(TestStatsUpdaterThread.java:644) at org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread.testTxnDynamicPartitions(TestStatsUpdaterThread.java:309) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) Caused by: MetaException(message:Cannot change stats state for a transactional table default.simple_stats without providing the transactional write state for verification (new write ID 5, valid write IDs null; current state {"BASIC_STATS":"true","COLUMN_STATS":{"s":"true"}}; new state null) at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:4328) at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitions(ObjectStore.java:4414) ... 66 more 2019-03-12T03:24:43,352 ERROR [main] metadata.Hive: MetaException(message:The transaction for alter partition did not commit successfully.) at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitions(ObjectStore.java:4432) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) at com.sun.proxy.$Proxy34.alterPartitions(Unknown Source) at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterPartitions(HiveAlterHandler.java:734) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_with_environment_context(HiveMetaStore.java:5156) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_req(HiveMetaStore.java:5108) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) at com.sun.proxy.$Proxy36.alter_partitions_req(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_partitions(HiveMetaStoreClient.java:2222) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) at com.sun.proxy.$Proxy37.alter_partitions(Unknown Source) at org.apache.hadoop.hive.metastore.SynchronizedMetaStoreClient.alter_partitions(SynchronizedMetaStoreClient.java:95) at org.apache.hadoop.hive.ql.metadata.Hive.setStatsPropAndAlterPartitions(Hive.java:2386) at org.apache.hadoop.hive.ql.metadata.Hive.loadDynamicPartitions(Hive.java:2727) at org.apache.hadoop.hive.ql.exec.MoveTask.handleDynParts(MoveTask.java:560) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2709) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2361) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2028) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1788) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1777) at org.apache.hadoop.hive.ql.DriverUtils.runOnDriver(DriverUtils.java:54) at org.apache.hadoop.hive.ql.DriverUtils.runOnDriver(DriverUtils.java:34) at org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread.executeQuery(TestStatsUpdaterThread.java:644) at org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread.testTxnDynamicPartitions(TestStatsUpdaterThread.java:309) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) Caused by: MetaException(message:Cannot change stats state for a transactional table default.simple_stats without providing the transactional write state for verification (new write ID 5, valid write IDs null; current state {"BASIC_STATS":"true","COLUMN_STATS":{"s":"true"}}; new state null) at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:4328) at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitions(ObjectStore.java:4414) ... 66 more FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MetaException(message:The transaction for alter partition did not commit successfully.) 2019-03-12T03:24:43,352 ERROR [main] ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MetaException(message:The transaction for alter partition did not commit successfully.) 2019-03-12T03:24:43,352 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase MapReduce Jobs Launched: 2019-03-12T03:24:43,353 INFO [main] ql.Driver: MapReduce Jobs Launched: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 SUCCESS 2019-03-12T03:24:43,353 INFO [main] ql.Driver: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 SUCCESS Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:43,353 INFO [main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec 2019-03-12T03:24:43,353 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e); Time taken: 1.272 seconds 2019-03-12T03:24:43,353 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032441_ae8ab768-86d9-4e16-9022-2bc13b11893e 2019-03-12T03:24:43,358 INFO [main] txn.TxnHandler: Removed aborted transactions: ([9]) from MIN_HISTORY_LEVEL 2019-03-12T03:24:43,363 ERROR [main] ql.DriverUtils: Failed to run insert into simple_stats (i, s) values (1, 'test12') org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:The transaction for alter partition did not commit successfully.) at org.apache.hadoop.hive.ql.metadata.Hive.loadDynamicPartitions(Hive.java:2739) ~[classes/:?] at org.apache.hadoop.hive.ql.exec.MoveTask.handleDynParts(MoveTask.java:560) ~[classes/:?] at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) ~[classes/:?] at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) ~[classes/:?] at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) ~[classes/:?] at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2709) ~[classes/:?] at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2361) ~[classes/:?] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2028) ~[classes/:?] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1788) ~[classes/:?] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1777) ~[classes/:?] at org.apache.hadoop.hive.ql.DriverUtils.runOnDriver(DriverUtils.java:54) [classes/:?] at org.apache.hadoop.hive.ql.DriverUtils.runOnDriver(DriverUtils.java:34) [classes/:?] at org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread.executeQuery(TestStatsUpdaterThread.java:644) [test-classes/:?] at org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread.testTxnDynamicPartitions(TestStatsUpdaterThread.java:309) [test-classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:?] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:?] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:?] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:?] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:?] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:?] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:?] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:?] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:?] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:?] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:?] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:?] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:?] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:?] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:?] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) [surefire-junit4-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) [surefire-booter-2.21.0.jar:2.21.0] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) [surefire-booter-2.21.0.jar:2.21.0] Caused by: org.apache.hadoop.hive.metastore.api.MetaException: The transaction for alter partition did not commit successfully. at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitions(ObjectStore.java:4432) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy34.alterPartitions(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterPartitions(HiveAlterHandler.java:734) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_with_environment_context(HiveMetaStore.java:5156) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_req(HiveMetaStore.java:5108) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy36.alter_partitions_req(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_partitions(HiveMetaStoreClient.java:2222) ~[hive-standalone-metastore-common-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) ~[hive-standalone-metastore-common-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy37.alter_partitions(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.SynchronizedMetaStoreClient.alter_partitions(SynchronizedMetaStoreClient.java:95) ~[classes/:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.ql.metadata.Hive.setStatsPropAndAlterPartitions(Hive.java:2386) ~[classes/:?] at org.apache.hadoop.hive.ql.metadata.Hive.loadDynamicPartitions(Hive.java:2727) ~[classes/:?] ... 40 more Caused by: org.apache.hadoop.hive.metastore.api.MetaException: Cannot change stats state for a transactional table default.simple_stats without providing the transactional write state for verification (new write ID 5, valid write IDs null; current state {"BASIC_STATS":"true","COLUMN_STATS":{"s":"true"}}; new state null at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:4328) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitions(ObjectStore.java:4414) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy34.alterPartitions(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterPartitions(HiveAlterHandler.java:734) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_with_environment_context(HiveMetaStore.java:5156) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_req(HiveMetaStore.java:5108) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) ~[hive-standalone-metastore-server-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy36.alter_partitions_req(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_partitions(HiveMetaStoreClient.java:2222) ~[hive-standalone-metastore-common-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_191] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_191] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_191] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_191] at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) ~[hive-standalone-metastore-common-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT] at com.sun.proxy.$Proxy37.alter_partitions(Unknown Source) ~[?:?] at org.apache.hadoop.hive.metastore.SynchronizedMetaStoreClient.alter_partitions(SynchronizedMetaStoreClient.java:95) ~[classes/:4.0.0-SNAPSHOT] at org.apache.hadoop.hive.ql.metadata.Hive.setStatsPropAndAlterPartitions(Hive.java:2386) ~[classes/:?] at org.apache.hadoop.hive.ql.metadata.Hive.loadDynamicPartitions(Hive.java:2727) ~[classes/:?] ... 40 more 2019-03-12T03:24:43,370 INFO [main] session.SessionState: Deleted directory: /work/hive21109/cr/ql/target/tmp/scratchdir/abapat/8e4d0a46-87b7-464c-9273-80437a13d4e9 on fs with scheme file 2019-03-12T03:24:43,371 INFO [main] session.SessionState: Deleted directory: /work/hive21109/cr/ql/target/tmp/localscratchdir/8e4d0a46-87b7-464c-9273-80437a13d4e9 on fs with scheme file 2019-03-12T03:24:43,380 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=Cleaning up thread local RawStore... 2019-03-12T03:24:43,380 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@3dd66ff5, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@d677be9 will be shutdown 2019-03-12T03:24:43,381 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore 2019-03-12T03:24:43,381 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5): drop table simple_stats 2019-03-12T03:24:43,382 INFO [main] metastore.HiveMetaStoreClient: HMS client filtering is enabled. 2019-03-12T03:24:43,383 INFO [main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore 2019-03-12T03:24:43,383 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2a3de2b, with PersistenceManager: null will be shutdown 2019-03-12T03:24:43,384 INFO [main] metastore.ObjectStore: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2a3de2b, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@22a9fa23 created in the thread with id: 1 2019-03-12T03:24:43,420 INFO [main] metastore.HiveMetaStore: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@2a3de2b from thread id: 1 2019-03-12T03:24:43,420 INFO [main] metastore.HiveMetaStore: HMS server filtering is disabled by configuration 2019-03-12T03:24:43,420 INFO [main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=abapat (auth:SIMPLE) retries=1 delay=1 lifetime=0 2019-03-12T03:24:43,432 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([10]) with min_open_txn: 10 2019-03-12T03:24:43,433 INFO [main] lockmgr.DbTxnManager: Opened txnid:10 2019-03-12T03:24:43,436 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:43,491 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:43,491 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2019-03-12T03:24:43,491 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:43,491 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5); Time taken: 0.11 seconds 2019-03-12T03:24:43,491 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:10 for queryId=abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5 2019-03-12T03:24:43,492 INFO [main] lockmgr.DbLockManager: Requesting: queryId=abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5 LockRequest(component:[LockComponent(type:EXCLUSIVE, level:TABLE, dbname:default, tablename:simple_stats, operationType:NO_TXN, isTransactional:true, isDynamicPartitionWrite:false)], txnid:10, user:abapat, hostname:ubuntu, agentInfo:abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5) 2019-03-12T03:24:43,516 INFO [main] lockmgr.DbLockManager: Response to queryId=abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5 LockResponse(lockid:7, state:ACQUIRED) 2019-03-12T03:24:43,516 INFO [main] ql.Driver: Operation DROPTABLE obtained 1 locks 2019-03-12T03:24:43,517 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5): drop table simple_stats 2019-03-12T03:24:43,518 INFO [main] ql.Driver: Starting task [Stage-0:DDL] in serial mode 2019-03-12T03:24:43,518 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:43,527 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats 2019-03-12T03:24:43,538 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=drop_table : tbl=hive.default.simple_stats 2019-03-12T03:24:43,816 INFO [main] txn.TxnHandler: Hacking in canned values for transaction manager 2019-03-12T03:24:43,821 INFO [main] txn.TxnDbUtil: Txn tables already exist, returning 2019-03-12T03:24:43,839 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase 2019-03-12T03:24:43,839 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5); Time taken: 0.322 seconds 2019-03-12T03:24:43,839 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032443_f3d054f2-208f-461e-8984-51ce6baee4b5 2019-03-12T03:24:43,845 INFO [main] txn.TxnHandler: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:10 2019-03-12T03:24:43,856 INFO [main] txn.TxnHandler: Removed committed transaction: (10) from MIN_HISTORY_LEVEL 2019-03-12T03:24:43,859 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032443_f2f39b7e-ee09-4d4d-bc32-c084df1f1555): drop table simple_stats2 2019-03-12T03:24:43,870 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([11]) with min_open_txn: 11 2019-03-12T03:24:43,870 INFO [main] lockmgr.DbTxnManager: Opened txnid:11 2019-03-12T03:24:43,875 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats2 2019-03-12T03:24:43,876 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:43,876 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2019-03-12T03:24:43,876 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:43,876 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032443_f2f39b7e-ee09-4d4d-bc32-c084df1f1555); Time taken: 0.017 seconds 2019-03-12T03:24:43,876 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:11 for queryId=abapat_20190312032443_f2f39b7e-ee09-4d4d-bc32-c084df1f1555 2019-03-12T03:24:43,877 INFO [main] ql.Driver: Operation DROPTABLE obtained 0 locks 2019-03-12T03:24:43,877 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032443_f2f39b7e-ee09-4d4d-bc32-c084df1f1555): drop table simple_stats2 2019-03-12T03:24:43,878 INFO [main] ql.Driver: Starting task [Stage-0:DDL] in serial mode 2019-03-12T03:24:43,878 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats2 2019-03-12T03:24:43,879 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats2 2019-03-12T03:24:43,880 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase 2019-03-12T03:24:43,880 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032443_f2f39b7e-ee09-4d4d-bc32-c084df1f1555); Time taken: 0.003 seconds 2019-03-12T03:24:43,880 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032443_f2f39b7e-ee09-4d4d-bc32-c084df1f1555 2019-03-12T03:24:43,887 INFO [main] txn.TxnHandler: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:11 2019-03-12T03:24:43,894 INFO [main] txn.TxnHandler: Removed committed transaction: (11) from MIN_HISTORY_LEVEL 2019-03-12T03:24:43,898 INFO [main] ql.Driver: Compiling command(queryId=abapat_20190312032443_376d94d5-eb59-4362-967b-1f8ab5ceef2c): drop table simple_stats3 2019-03-12T03:24:43,909 INFO [main] txn.TxnHandler: Added entries to MIN_HISTORY_LEVEL for current txns: ([12]) with min_open_txn: 12 2019-03-12T03:24:43,909 INFO [main] lockmgr.DbTxnManager: Opened txnid:12 2019-03-12T03:24:43,913 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats3 2019-03-12T03:24:43,915 INFO [main] ql.Driver: Semantic Analysis Completed (retrial = false) 2019-03-12T03:24:43,915 INFO [main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2019-03-12T03:24:43,915 INFO [main] metadata.Hive: Dumping metastore api call timing information for : compilation phase 2019-03-12T03:24:43,915 INFO [main] ql.Driver: Completed compiling command(queryId=abapat_20190312032443_376d94d5-eb59-4362-967b-1f8ab5ceef2c); Time taken: 0.017 seconds 2019-03-12T03:24:43,915 INFO [main] lockmgr.DbTxnManager: Setting lock request transaction to txnid:12 for queryId=abapat_20190312032443_376d94d5-eb59-4362-967b-1f8ab5ceef2c 2019-03-12T03:24:43,915 INFO [main] ql.Driver: Operation DROPTABLE obtained 0 locks 2019-03-12T03:24:43,916 INFO [main] ql.Driver: Executing command(queryId=abapat_20190312032443_376d94d5-eb59-4362-967b-1f8ab5ceef2c): drop table simple_stats3 2019-03-12T03:24:43,916 INFO [main] ql.Driver: Starting task [Stage-0:DDL] in serial mode 2019-03-12T03:24:43,916 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats3 2019-03-12T03:24:43,917 INFO [main] HiveMetaStore.audit: ugi=abapat ip=unknown-ip-addr cmd=get_table : tbl=hive.default.simple_stats3 2019-03-12T03:24:43,918 INFO [main] metadata.Hive: Dumping metastore api call timing information for : execution phase 2019-03-12T03:24:43,918 INFO [main] ql.Driver: Completed executing command(queryId=abapat_20190312032443_376d94d5-eb59-4362-967b-1f8ab5ceef2c); Time taken: 0.002 seconds 2019-03-12T03:24:43,919 INFO [main] lockmgr.DbTxnManager: Stopped heartbeat for query: abapat_20190312032443_376d94d5-eb59-4362-967b-1f8ab5ceef2c 2019-03-12T03:24:43,927 INFO [main] txn.TxnHandler: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:12 2019-03-12T03:24:43,935 INFO [main] txn.TxnHandler: Removed committed transaction: (12) from MIN_HISTORY_LEVEL