[ACCUMULO-3766] Bulk ingest fails on volume configuration mismatch

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.7.0
• Component/s: client
• Assignee: Josh Elser
• Reporter: Josh Elser
• Created: 30/Apr/15 21:28
• Updated: 01/May/15 20:41
• Resolved: 01/May/15 20:41

Description

Saw this running the Bulk randomwalk module

error preparing the bulk import directory
	java.io.IOException: hdfs://jelser-accumulo-6.novalocal:8020/tmp/bulk_15333dff-747b-47e2-ae23-781da54da3f4 is not in a volume configured for Accumulo
		at org.apache.accumulo.master.tableOps.BulkImport.createNewBulkDir(BulkImport.java:149)
		at org.apache.accumulo.master.tableOps.BulkImport.prepareBulkImport(BulkImport.java:178)
		at org.apache.accumulo.master.tableOps.BulkImport.call(BulkImport.java:136)
		at org.apache.accumulo.master.tableOps.BulkImport.call(BulkImport.java:70)
		at org.apache.accumulo.master.tableOps.TraceRepo.call(TraceRepo.java:57)
		at org.apache.accumulo.fate.Fate$TransactionRunner.run(Fate.java:73)
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
		at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
		at java.lang.Thread.run(Thread.java:745)

accumulo-site.xml has

  <property>
    <name>instance.volumes</name>
    <value>hdfs://jelser-accumulo-6:8020/user/accumulo/data</value>
    <description>comma separated list of URIs for volumes. example: hdfs://localhost:9000/accumulo</description>
  </property>

My hunch is that I had issues because I put in the shortname instead of the FQDN in instance.volumes.

Some thoughts:

1. Can we make this error detection smarter?
2. Do we have this issue documented (where multiple names can refer to the same namenode)?

Marked as blocker against 1.7.0 to get visibility and discussion.