Hadoop Common
  1. Hadoop Common
  2. HADOOP-8878

uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.3, 1.1.0, 1.2.0, 3.0.0
    • Fix Version/s: 1.1.1, 2.0.3-alpha, 0.23.7
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This was noticed on a secure cluster where the namenode had an upper case hostname and the following command was issued

      hadoop dfs -ls webhdfs://NN:PORT/PATH

      the above command failed because delegation token retrieval failed.

      Upon looking at the kerberos logs it was determined that we tried to get the ticket for kerberos principal with upper case hostnames and that host did not exit in kerberos. We should convert the hostnames to lower case. Take a look at HADOOP-7988 where the same fix was applied on a different class.

      I have noticed this issue exists on branch-1. Will investigate trunk and branch-2 and update accordingly.

      1. HADOOP-8878.patch
        1 kB
        Arpit Gupta
      2. HADOOP-8878.patch
        6 kB
        Arpit Gupta
      3. HADOOP-8878.patch
        6 kB
        Arpit Gupta
      4. HADOOP-8878.branch-1.patch
        1 kB
        Arpit Gupta
      5. HADOOP-8878.branch-1.patch
        6 kB
        Arpit Gupta
      6. HADOOP-8878.branch-1.patch
        6 kB
        Arpit Gupta

        Issue Links

          Activity

          Arpit Gupta created issue -
          Arpit Gupta made changes -
          Field Original Value New Value
          Attachment HADOOP-8878.branch-1.patch [ 12547650 ]
          Arpit Gupta made changes -
          Summary uppercase hostname causes hadoop dfs calls with webhdfs filesystem to fail uppercase hostname causes hadoop dfs calls with webhdfs filesystem to fail when security is on
          Arpit Gupta made changes -
          Affects Version/s 3.0.0 [ 12320357 ]
          Arpit Gupta made changes -
          Attachment HADOOP-8878.patch [ 12547655 ]
          Arpit Gupta made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arpit Gupta made changes -
          Summary uppercase hostname causes hadoop dfs calls with webhdfs filesystem to fail when security is on uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem to fail when security is on
          Arpit Gupta made changes -
          Link This issue relates to HADOOP-7988 [ HADOOP-7988 ]
          Arpit Gupta made changes -
          Summary uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem to fail when security is on uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on
          Arpit Gupta made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arpit Gupta made changes -
          Attachment HADOOP-8878.branch-1.patch [ 12547796 ]
          Arpit Gupta made changes -
          Attachment HADOOP-8878.patch [ 12548033 ]
          Arpit Gupta made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arpit Gupta made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arpit Gupta made changes -
          Attachment HADOOP-8878.branch-1.patch [ 12548433 ]
          Arpit Gupta made changes -
          Attachment HADOOP-8878.patch [ 12548435 ]
          Arpit Gupta made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arpit Gupta made changes -
          Link This issue blocks HADOOP-8882 [ HADOOP-8882 ]
          Suresh Srinivas made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 1.2.0 [ 12321659 ]
          Fix Version/s 2.0.3-alpha [ 12323273 ]
          Resolution Fixed [ 1 ]
          Matt Foley made changes -
          Fix Version/s 1.1.1 [ 12321658 ]
          Fix Version/s 1.2.0 [ 12321659 ]
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Thomas Graves made changes -
          Fix Version/s 0.23.7 [ 12323956 ]
          Gavin made changes -
          Link This issue blocks HADOOP-8882 [ HADOOP-8882 ]
          Gavin made changes -
          Link This issue is depended upon by HADOOP-8882 [ HADOOP-8882 ]

            People

            • Assignee:
              Arpit Gupta
              Reporter:
              Arpit Gupta
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development