[SENTRY-1627] Support viewfs in Sentry Namenode plugin

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.5.1
• Fix Version/s: 1.5.1
• Component/s: Hdfs Plugin, Hive Plugin, Sentry
• Labels: experimental hdfs viewfs
• Assignee: Unassigned
• Reporter: Qianbo Huai
• Created: 14/Feb/17 21:21
• Updated: 30/Apr/19 02:51

Description

The View File System (ViewFs) provides a way to manage multiple Hadoop file system namespaces (or namespace volumes). It is particularly useful for clusters having multiple namenodes, and hence multiple namespaces, in HDFS Federation. ViewFs is analogous to client side mount tables in some Unix/Linux systems.

In a ViewFs deployment, Sentry MetastorePlugin sees viewfs schemed paths but drops them in PathsUpdate.parsePath as it hardcodes the support for only hdfs schemed path.

If paths updates are sent to Sentry Namenode plugin, the viewfs paths need to be converted to per-namenode (HDFS cluster) paths.