Description
Tried to run continuous-verify after an ingest run, got to the reducers and they failed:
2014-07-24 05:27:40,115 FATAL [IPC Server handler 0 on 49956] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1406166419302_0001_r_000011_3 - exited : java.lang.ClassNotFoundException: org.apache.accumulo.server.util.reflection.CounterUtils at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at org.apache.accumulo.test.continuous.ContinuousVerify$CReducer.reduce(ContinuousVerify.java:137) at org.apache.accumulo.test.continuous.ContinuousVerify$CReducer.reduce(ContinuousVerify.java:105) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
With the introduction of a proper accumulo-test jar, this class moved out of server, but the libjars value was never updated in the merge and subsequently broke verify.
The method is inlined in 1.6, so 1.6+ isn't broken. It appears that the merge up from 1.4 to 1.5 wasn't performed properly which introduced this in the first place. I'm not confident 1.4 isn't broken too, but since it's EOL, I'm not going to bother to investigate there.
Attachments
Issue Links
- is broken by
-
ACCUMULO-1421 use reflection to improve compatibility between Hadoop 1 and 2
- Resolved