[ACCUMULO-1244] commons-io version conflict with CDH4

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0

Environment

Hadoop version 2.0.0-CDH4.2.0

• Assignee: Christopher Tubbs
• Reporter: Adam Fuchs
• Created: 05/Apr/13 03:08
• Updated: 26/Nov/13 15:47
• Resolved: 18/Apr/13 16:17

Description

CDH4 appears to rely on commons-io version 2.0 or greater. Accumulo currently packages in version 1.4. We should bump this up to achieve compatibility.

Workaround: put the hadoop dependency libraries before the accumulo dependency libraries in the general.classpaths variable in accumulo-site.xml.

2013-04-04 22:27:13,868 [tabletserver.Tablet] ERROR: Unknown error during minor compaction for extent: !0;~;!0<
java.lang.RuntimeException: java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/Closeable;)V
  at org.apache.accumulo.server.tabletserver.Tablet.minorCompact(Tablet.java:2152)
  at org.apache.accumulo.server.tabletserver.Tablet.access$4400(Tablet.java:152)
  at org.apache.accumulo.server.tabletserver.Tablet$MinorCompactionTask.run(Tablet.java:2219)
  at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
  at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
  at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
  at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
  at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/Closeable;)V
  at org.apache.hadoop.hdfs.DFSInputStream.getBlockReader(DFSInputStream.java:941)
  at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:471)
  at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:662)
  at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:706)
  at java.io.DataInputStream.read(DataInputStream.java:132)
  at java.io.DataInputStream.readFully(DataInputStream.java:178)
  at java.io.DataInputStream.readLong(DataInputStream.java:399)
  at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Reader.<init>(BCFile.java:608)
  at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Reader.init(CachableBlockFile.java:246)
  at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Reader.getBCFile(CachableBlockFile.java:257)
  at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Reader.access$000(CachableBlockFile.java:143)
  at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Reader$MetaBlockLoader.get(CachableBlockFile.java:212)
  at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Reader.getBlock(CachableBlockFile.java:313)
  at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Reader.getMetaBlock(CachableBlockFile.java:367)
  at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Reader.getMetaBlock(CachableBlockFile.java:143)
  at org.apache.accumulo.core.file.rfile.RFile$Reader.<init>(RFile.java:834)
  at org.apache.accumulo.core.file.rfile.RFileOperations.openReader(RFileOperations.java:79)
  at org.apache.accumulo.core.file.DispatchingFileFactory.openReader(FileOperations.java:72)
  at org.apache.accumulo.server.tabletserver.Compactor.call(Compactor.java:317)
  at org.apache.accumulo.server.tabletserver.MinorCompactor.call(MinorCompactor.java:96)
  at org.apache.accumulo.server.tabletserver.Tablet.minorCompact(Tablet.java:2138)
  ... 9 more

Issue Links

• is related to: ACCUMULO-1320 Document "provided" dependencies
• relates to: ACCUMULO-1063 Update pom.xml to reference Commons IO v2.4 (or change Instamo to remove dependency)