[AVRO-1991] Java concat tool -appendToFirst option doesn't work with local filesystem

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.9.0
• Component/s: java
• Assignee: Nándor Kollár
• Reporter: Sean Busbey
• Created: 28/Jan/17 09:05
• Updated: 01/Sep/17 14:58

Description

We should either make it work (e.g. by switching to RawLocalFilesytem instead of LocalFileSystem) or update the cli help.

 java -jar lang/java/tools/target/avro-tools-1.9.0-SNAPSHOT.jar concat -appendToFirst ~/Downloads/append.0.avro '/Users/busbey/Downloads/example.*.avro'
log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Exception in thread "main" java.io.IOException: Not supported
	at org.apache.hadoop.fs.ChecksumFileSystem.append(ChecksumFileSystem.java:352)
	at org.apache.hadoop.fs.FileSystem.append(FileSystem.java:1161)
	at org.apache.avro.tool.Util.createFromFS(Util.java:150)
	at org.apache.avro.tool.Util.fileOrStdout(Util.java:76)
	at org.apache.avro.tool.ConcatTool.run(ConcatTool.java:76)
	at org.apache.avro.tool.Main.run(Main.java:87)
	at org.apache.avro.tool.Main.main(Main.java:76)

Issue Links

• depends upon: AVRO-1856 Update ConcatTool to support appending to an input file instead of creating a new output file