[HADOOP-11201] Hadoop Archives should support globs resolving to files

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.0.5-alpha
• Fix Version/s: 2.7.0
• Component/s: tools
• Target Version/s: 2.7.0
• Hadoop Flags: Reviewed
• Assignee: Gera Shegalov
• Reporter: Gera Shegalov
• Created: 14/Oct/14 08:39
• Updated: 10/Apr/15 20:04
• Resolved: 19/Nov/14 01:13

Description

Consider the following scenario:

$ hadoop fs -ls /tmp/harsrc/dir2/dir3
Found 5 items
-rw-r--r--   1 blah blah          0 2014-10-13 20:59 /tmp/harsrc/dir2/dir3/file31
-rw-r--r--   1 blah blah          0 2014-10-14 01:51 /tmp/harsrc/dir2/dir3/file32
-rw-r--r--   1 blah blah          0 2014-10-14 01:51 /tmp/harsrc/dir2/dir3/file33
-rw-r--r--   1 blah blah          0 2014-10-14 01:51 /tmp/harsrc/dir2/dir3/file34
-rw-r--r--   1 blah blah          0 2014-10-14 01:51 /tmp/harsrc/dir2/dir3/file35

Archive 'dir3/file3*':

$ hadoop archive -Dmapreduce.framework.name=local -archiveName fileStar.har -p /tmp/harsrc 'dir2/dir3/file*' /tmp/hardst_local
$ hadoop fs -ls -R har:/tmp/hardst_local/fileStar.har
drwxr-xr-x   - blah blah          0 2014-10-13 22:32 har:///tmp/hardst_local/fileStar.har/dir2

Archiving dir3 (directory) which is equivalent to the above works.

$ hadoop archive -Dmapreduce.framework.name=local -archiveName dir3.har -p /tmp/harsrc 'dir2/dir3' /tmp/hardst_local
$ hadoop fs -ls -R har:/tmp/hardst_local/dir3.har
14/10/14 02:06:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
drwxr-xr-x   - blah blah          0 2014-10-13 22:32 har:///tmp/hardst_local/dir3.har/dir2
drwxr-xr-x   - blah blah          0 2014-10-14 01:51 har:///tmp/hardst_local/dir3.har/dir2/dir3
-rw-r--r--   1 blah blah          0 2014-10-13 20:59 har:///tmp/hardst_local/dir3.har/dir2/dir3/file31
-rw-r--r--   1 blah blah          0 2014-10-14 01:51 har:///tmp/hardst_local/dir3.har/dir2/dir3/file32
-rw-r--r--   1 blah blah          0 2014-10-14 01:51 har:///tmp/hardst_local/dir3.har/dir2/dir3/file33
-rw-r--r--   1 blah blah          0 2014-10-14 01:51 har:///tmp/hardst_local/dir3.har/dir2/dir3/file34
-rw-r--r--   1 blah blah          0 2014-10-14 01:51 har:///tmp/hardst_local/dir3.har/dir2/dir3/file35