[AVRO-1909] Make concat tool handle directories as input

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 1.8.1
• Component/s: java
• Assignee: Unassigned
• Reporter: Sebastian Wallin
• Created: 07/Sep/16 09:52
• Updated: 28/Jan/17 08:23
• Resolved: 27/Jan/17 17:00

Description

I'm having a situation where I want to concatenate thousands of files in a directory. Currently this generates `Argument list too long` when the shell tries to expand into a list of files.

It would be great for the `concat` tool to handle directories as input for use cases like this, as well as being consistent with the `cat` tool

There is a similar issue filed (AVRO-1787), which requests both directories and glob patters to be handled. IMHO it would be enough to make the `concat` tool handle directories, as a start. It would also require a lot less code to be changed.

Issue Links

• duplicates: AVRO-1787 Add support of directories & globs to concat and cat
• links to: GitHub Pull Request #120