2012-01-23 18:04:01,714 WARN org.apache.hadoop.conf.Configuration: /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/job.xml:a attempt to override final parameter: fs.default.name; Ignoring. 2012-01-23 18:04:01,715 WARN org.apache.hadoop.conf.Configuration: /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/job.xml:a attempt to override final parameter: mapred.job.tracker; Ignoring. 2012-01-23 18:04:01,747 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2012-01-23 18:04:01,886 INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: /srv/tasktracker/data/taskTracker/distcache/7770560037036072696_1306250502_193342525/data-1.myapp/tmp/hive-myapp-mapred/hive_2012-01-23_18-03-48_351_5575930175821673610/-mr-10006/82a52ce3-a86d-4bc2-a75e-7d1352c1f2e7 <- /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/attempt_201201211628_1061_r_000000_0/work/HIVE_PLAN82a52ce3-a86d-4bc2-a75e-7d1352c1f2e7 2012-01-23 18:04:01,892 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/jars/.job.jar.crc <- /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/attempt_201201211628_1061_r_000000_0/work/.job.jar.crc 2012-01-23 18:04:01,894 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/jars/job.jar <- /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/attempt_201201211628_1061_r_000000_0/work/job.jar 2012-01-23 18:04:01,935 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId= 2012-01-23 18:04:01,989 WARN org.apache.hadoop.conf.Configuration: /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/job.xml:a attempt to override final parameter: dfs.data.dir; Ignoring. 2012-01-23 18:04:01,994 WARN org.apache.hadoop.conf.Configuration: /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/job.xml:a attempt to override final parameter: fs.default.name; Ignoring. 2012-01-23 18:04:01,994 WARN org.apache.hadoop.conf.Configuration: /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/job.xml:a attempt to override final parameter: mapred.job.tracker; Ignoring. 2012-01-23 18:04:01,994 WARN org.apache.hadoop.conf.Configuration: /srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring. 2012-01-23 18:04:02,031 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=130514944, MaxSingleShuffleLimit=32628736 2012-01-23 18:04:02,037 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201211628_1061_r_000000_0 Thread started: Thread for merging on-disk files 2012-01-23 18:04:02,037 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201211628_1061_r_000000_0 Thread waiting: Thread for merging on-disk files 2012-01-23 18:04:02,039 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201211628_1061_r_000000_0 Thread started: Thread for merging in memory files 2012-01-23 18:04:02,039 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201211628_1061_r_000000_0 Need another 1 map output(s) where 0 is already in progress 2012-01-23 18:04:02,039 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201211628_1061_r_000000_0 Thread started: Thread for polling Map Completion Events 2012-01-23 18:04:02,039 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201211628_1061_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2012-01-23 18:04:07,039 INFO org.apache.hadoop.mapred.ReduceTask: attempt_201201211628_1061_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2012-01-23 18:04:08,049 INFO org.apache.hadoop.mapred.ReduceTask: GetMapEventsThread exiting 2012-01-23 18:04:08,049 INFO org.apache.hadoop.mapred.ReduceTask: getMapsEventsThread joined. 2012-01-23 18:04:08,050 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager 2012-01-23 18:04:08,050 INFO org.apache.hadoop.mapred.ReduceTask: Interleaved on-disk merge complete: 0 files left. 2012-01-23 18:04:08,050 INFO org.apache.hadoop.mapred.ReduceTask: In-memory merge complete: 1 files left. 2012-01-23 18:04:08,057 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments 2012-01-23 18:04:08,057 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes 2012-01-23 18:04:08,061 INFO org.apache.hadoop.mapred.ReduceTask: Merged 1 segments, 2 bytes to disk to satisfy reduce memory limit 2012-01-23 18:04:08,062 INFO org.apache.hadoop.mapred.ReduceTask: Merging 1 files, 6 bytes from disk 2012-01-23 18:04:08,062 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce 2012-01-23 18:04:08,062 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments 2012-01-23 18:04:08,065 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes 2012-01-23 18:04:08,072 INFO ExecReducer: maximum memory = 186449920 2012-01-23 18:04:08,072 INFO ExecReducer: conf classpath = [file:/srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/jars/classes, file:/srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/jars/, file:/srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/attempt_201201211628_1061_r_000000_0/] 2012-01-23 18:04:08,072 INFO ExecReducer: thread classpath = [file:/etc/hadoop-0.20/conf.qa_cluster/, file:/usr/lib/jvm/java-6-sun-1.6.0.26/lib/tools.jar, file:/usr/lib/hadoop-0.20/, file:/usr/lib/hadoop-0.20/hadoop-core-0.20.2-cdh3u2.jar, file:/usr/lib/hadoop-0.20/lib/ant-contrib-1.0b3.jar, file:/usr/lib/hadoop-0.20/lib/aspectjrt-1.6.5.jar, file:/usr/lib/hadoop-0.20/lib/aspectjtools-1.6.5.jar, file:/usr/lib/hadoop-0.20/lib/commons-cli-1.2.jar, file:/usr/lib/hadoop-0.20/lib/commons-codec-1.4.jar, file:/usr/lib/hadoop-0.20/lib/commons-daemon-1.0.1.jar, file:/usr/lib/hadoop-0.20/lib/commons-el-1.0.jar, file:/usr/lib/hadoop-0.20/lib/commons-httpclient-3.1.jar, file:/usr/lib/hadoop-0.20/lib/commons-logging-1.0.4.jar, file:/usr/lib/hadoop-0.20/lib/commons-logging-api-1.0.4.jar, file:/usr/lib/hadoop-0.20/lib/commons-net-1.4.1.jar, file:/usr/lib/hadoop-0.20/lib/core-3.1.1.jar, file:/usr/lib/hadoop-0.20/lib/hadoop-fairscheduler-0.20.2-cdh3u2.jar, file:/usr/lib/hadoop-0.20/lib/hsqldb-1.8.0.10.jar, file:/usr/lib/hadoop-0.20/lib/jackson-core-asl-1.5.2.jar, file:/usr/lib/hadoop-0.20/lib/jackson-mapper-asl-1.5.2.jar, file:/usr/lib/hadoop-0.20/lib/jasper-compiler-5.5.12.jar, file:/usr/lib/hadoop-0.20/lib/jasper-runtime-5.5.12.jar, file:/usr/lib/hadoop-0.20/lib/jets3t-0.6.1.jar, file:/usr/lib/hadoop-0.20/lib/jetty-6.1.26.cloudera.1.jar, file:/usr/lib/hadoop-0.20/lib/jetty-servlet-tester-6.1.26.cloudera.1.jar, file:/usr/lib/hadoop-0.20/lib/jetty-util-6.1.26.cloudera.1.jar, file:/usr/lib/hadoop-0.20/lib/jsch-0.1.42.jar, file:/usr/lib/hadoop-0.20/lib/junit-4.5.jar, file:/usr/lib/hadoop-0.20/lib/kfs-0.2.2.jar, file:/usr/lib/hadoop-0.20/lib/log4j-1.2.15.jar, file:/usr/lib/hadoop-0.20/lib/mockito-all-1.8.2.jar, file:/usr/lib/hadoop-0.20/lib/oro-2.0.8.jar, file:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-20081211.jar, file:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-6.1.14.jar, file:/usr/lib/hadoop-0.20/lib/slf4j-api-1.4.3.jar, file:/usr/lib/hadoop-0.20/lib/slf4j-log4j12-1.4.3.jar, file:/usr/lib/hadoop-0.20/lib/xmlenc-0.52.jar, file:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-2.1.jar, file:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-api-2.1.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/jars/classes, file:/srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/jars/job.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-6175402984067479250_1230863603_193342784/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/hive-builtins-0.8.0.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-5591492005895539215_1870168530_193342809/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/myapp-myapp-mapred.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/2102603874075347759_-2001171595_193342852/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/cassandra-thrift.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/1226432451789525609_-1324680909_193342910/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/cassandra-all.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-5484584252552609342_1737138142_193343001/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/libfb303.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-4516699429377109314_1488372753_193343034/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/libthrift.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-8860919347704698903_-261927488_193343075/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/commons-lang.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/8007327781272693273_-927407061_193343108/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/json.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-2527820644044187106_-216010639_193343142/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/guava.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-18303574859816421_-2138218148_193343192/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/high-scale-lib.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/5366134336779487711_-1084933299_193343244/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/jackson-core-asl.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-5742715341953833987_1852265451_193343275/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/jackson-mapper-asl.jar, file:/srv/tasktracker/data/taskTracker/myapp-mapred/jobcache/job_201201211628_1061/attempt_201201211628_1061_r_000000_0/work/] 2012-01-23 18:04:08,092 WARN org.apache.hadoop.hive.conf.HiveConf: DEPRECATED: Ignoring hive-default.xml found on the CLASSPATH at file:/srv/tasktracker/data/taskTracker/myapp-mapred/distcache/-5591492005895539215_1870168530_193342809/data-1.myapp/tmp/hadoop-mapred/mapred/staging/myapp-mapred/.staging/job_201201211628_1061/libjars/myapp-myapp-mapred.jar!/hive-default.xml 2012-01-23 18:04:08,092 WARN org.apache.hadoop.hive.conf.HiveConf: hive-site.xml not found on CLASSPATH 2012-01-23 18:04:08,364 INFO ExecReducer: Id =2 Id =3 Id =4 Id = 3 null<\Parent> <\FS> <\Children> Id = 2 null<\Parent> <\SEL> <\Children> <\GBY> 2012-01-23 18:04:08,364 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: Initializing Self 2 GBY 2012-01-23 18:04:08,373 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: Operator 2 GBY initialized 2012-01-23 18:04:08,374 INFO org.apache.hadoop.hive.ql.exec.GroupByOperator: Initializing children of 2 GBY 2012-01-23 18:04:08,374 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing child 3 SEL 2012-01-23 18:04:08,374 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: Initializing Self 3 SEL 2012-01-23 18:04:08,461 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: SELECT struct<_col0:bigint,_col1:map> 2012-01-23 18:04:08,471 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1 2012-01-23 18:04:08,473 WARN org.apache.hadoop.mapred.Child: Error running child java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:432) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417) at org.apache.hadoop.mapred.Child$4.run(Child.java:270) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) at org.apache.hadoop.mapred.Child.main(Child.java:264) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) ... 9 more Caused by: java.lang.RuntimeException: Reduce operator initialization failed at org.apache.hadoop.hive.ql.exec.ExecReducer.configure(ExecReducer.java:157) ... 14 more Caused by: java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:137) at org.apache.hadoop.hive.ql.exec.Operator.initEvaluators(Operator.java:896) at org.apache.hadoop.hive.ql.exec.Operator.initEvaluatorsAndReturnStruct(Operator.java:922) at org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:60) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:433) at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:389) at org.apache.hadoop.hive.ql.exec.GroupByOperator.initializeOp(GroupByOperator.java:384) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.ExecReducer.configure(ExecReducer.java:150) ... 14 more 2012-01-23 18:04:08,475 INFO org.apache.hadoop.mapred.Task: Runnning cleanup for the task