[HDFS-15427] Merged ListStatus with Fallback target filesystem and InternalDirViewFS.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.1
• Fix Version/s: 3.2.2, 3.3.1, 3.4.0
• Component/s: viewfs
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Uma Maheswara Rao G
• Reporter: Uma Maheswara Rao G
• Created: 22/Jun/20 07:45
• Updated: 10/Jun/21 07:44
• Resolved: 23/Jun/20 08:43

Description

Currently ListStatus will not consider fallback directory when passed path is an internal Directory(except root).

Since we configured fallback, we should be able to list fallback directories when passed path is internal directory. It should list the union of fallbackDir and internalDir.

So, that fallback directories will not be shaded when path matched to internal dir.

 

The idea here is, user configured default filesystem with fallback fs, then every operation not having link should go to fallback fs. That way users need not configure all paths as mount from default fs.

 

This will be very useful in the case of ViewFSOverloadScheme. 

In ViewFSOverloadScheme, if you choose your existing cluster to be configured as fallback fs, then you can configure desired mount paths to external fs and rest other path should go to fallback.  

Issue Links

• links to: GitHub Pull Request #2088