Hadoop Common
  1. Hadoop Common
  2. HADOOP-7951

viewfs fails unless all mount points are available

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Critical Critical
    • Resolution: Unresolved
    • Affects Version/s: 0.23.1, 0.24.0
    • Fix Version/s: None
    • Component/s: viewfs
    • Labels:
      None

      Description

      Obtaining a delegation token via viewfs will attempt to acquire tokens from all filesystems in the mount table. All clients that obtain tokens, including job submissions, will fail if any of the mount points are unavailable – even if paths in the unavailable mount will not be accessed.

        Issue Links

          Activity

          Hide
          Daryn Sharp added a comment -

          I thought of this while reflecting on HADOOP-7933, although I believe the issue pre-dates that jira.

          Show
          Daryn Sharp added a comment - I thought of this while reflecting on HADOOP-7933 , although I believe the issue pre-dates that jira.
          Hide
          Harsh J added a comment -

          Is this related to HADOOP-7950?

          Show
          Harsh J added a comment - Is this related to HADOOP-7950 ?
          Hide
          Daryn Sharp added a comment -

          One possible/conceptual approach is viewfs issues a virtual-token. The real token for the underlying mount point of a path would be dynamically acquired on-demand and cached. The viewfs token's renewer would need to be aware of these cached tokens so the renew/cancel methods operate on all acquired tokens. The UGI would need to be updated to allow the ipc client to locate the tokens.

          Show
          Daryn Sharp added a comment - One possible/conceptual approach is viewfs issues a virtual-token. The real token for the underlying mount point of a path would be dynamically acquired on-demand and cached. The viewfs token's renewer would need to be aware of these cached tokens so the renew/cancel methods operate on all acquired tokens. The UGI would need to be updated to allow the ipc client to locate the tokens.

            People

            • Assignee:
              Unassigned
              Reporter:
              Daryn Sharp
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:

                Development