Hadoop Common
  1. Hadoop Common
  2. HADOOP-8299

ViewFs doesn't work with a slash mount point

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: None
    • Component/s: viewfs
    • Labels:
      None

      Description

      We currently assume a typical viewfs client configuration is a set of non-overlapping mounts. This means every time you want to add a new top-level directory you need to update the client-side mountable config. If users could specify a slash mount, and then add additional mounts as necessary they could add a new top-level directory without updating all client configs (as long as the new top-level directory was being created on the NN the slash mount points to). This could be achieved by HADOOP-8298 (merge mounts, since we're effectively merging all new mount points with slash) or having the notion of a "default NN" for a mount table.

        Activity

        Hide
        Eli Collins added a comment -

        Here's the exception you get btw if you try to create a slash mount entry. We should make this a more friendly error message in the mean time.

        java.lang.ArrayIndexOutOfBoundsException: 1
        at org.apache.hadoop.fs.viewfs.InodeTree.createLink(InodeTree.java:237)
        at org.apache.hadoop.fs.viewfs.InodeTree.<init>(InodeTree.java:334)
        at org.apache.hadoop.fs.viewfs.ViewFileSystem$1.<init>(ViewFileSystem.java:165)
        at org.apache.hadoop.fs.viewfs.ViewFileSystem.initialize(ViewFileSystem.java:165)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2041)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:78)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2075)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2057)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:284)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:151)
        
        Show
        Eli Collins added a comment - Here's the exception you get btw if you try to create a slash mount entry. We should make this a more friendly error message in the mean time. java.lang.ArrayIndexOutOfBoundsException: 1 at org.apache.hadoop.fs.viewfs.InodeTree.createLink(InodeTree.java:237) at org.apache.hadoop.fs.viewfs.InodeTree.<init>(InodeTree.java:334) at org.apache.hadoop.fs.viewfs.ViewFileSystem$1.<init>(ViewFileSystem.java:165) at org.apache.hadoop.fs.viewfs.ViewFileSystem.initialize(ViewFileSystem.java:165) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2041) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:78) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2075) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2057) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:284) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:151)

          People

          • Assignee:
            Unassigned
            Reporter:
            Eli Collins
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:

              Development