Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 2.0.6-alpha
    • Component/s: None
    • Labels:
      None

      Description

      There are multiple scripts and projects like pig, hive, elephantbird refer to HDFS URI as hdfs://namenodehostport/ or hdfs:/// . In federated namespace this causes problem because supported scheme for federation is viewfs:// . We will have to force all users to change their scripts/programs to be able to access federated cluster.

      It would be great if thee was a way to map viewfs scheme to hdfs scheme without exposing it to users. Opening this JIRA to get inputs from people who have thought about this in their clusters.

      In our clusters we ended up created another class HDFSCompatibleViewFileSystem which hijacks both hdfs.fs.impl and viewfs.fs.impl and passes down filesystem calls to ViewFileSystem. Is there any suggested approach other than this?

        Issue Links

          Activity

          Lohit Vijayarenu created issue -
          Hide
          Lohit Vijayarenu added a comment -

          Can somebody close this, this was opened by mistake as part of retry of HADOOP-9985. I dont seem to have option to close this JIRA

          Show
          Lohit Vijayarenu added a comment - Can somebody close this, this was opened by mistake as part of retry of HADOOP-9985 . I dont seem to have option to close this JIRA
          Gera Shegalov made changes -
          Field Original Value New Value
          Link This issue duplicates HADOOP-9985 [ HADOOP-9985 ]
          Gera Shegalov made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Duplicate [ 3 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          250d 11h 45m 1 Gera Shegalov 29/May/14 09:31

            People

            • Assignee:
              Unassigned
              Reporter:
              Lohit Vijayarenu
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development