Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1718

job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.22.0
    • Component/s: None
    • Labels:
      None
    • Tags:
      security

      Description

      the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but
      in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT.

      Fix. change it to always be IP.

      1. MAPREDUCE-1718-BP20-2.patch
        9 kB
        Boris Shkolnik
      2. MAPREDUCE-1718-BP20-1.patch
        3 kB
        Boris Shkolnik
      3. MAPREDUCE-1718-4.patch
        13 kB
        Boris Shkolnik
      4. MAPREDUCE-1718-4.patch
        13 kB
        Boris Shkolnik
      5. MAPREDUCE-1718-3.patch
        12 kB
        Boris Shkolnik
      6. MAPREDUCE-1718-2.patch
        12 kB
        Boris Shkolnik

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/)

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/ )
          Hide
          Devaraj Das added a comment -

          I just committed this. Thanks, Boris!

          Show
          Devaraj Das added a comment - I just committed this. Thanks, Boris!
          Hide
          Boris Shkolnik added a comment -

          merged with trunk.
          Ran tests all passed (except TestRumenJobTraces - see MAPREDUCE-1925)

          Show
          Boris Shkolnik added a comment - merged with trunk. Ran tests all passed (except TestRumenJobTraces - see MAPREDUCE-1925 )
          Hide
          Boris Shkolnik added a comment -

          merged with the trunk.
          modified test to verify value set in conf .

          Show
          Boris Shkolnik added a comment - merged with the trunk. modified test to verify value set in conf .
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk #398 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Common-trunk/398/)
          HADOOP-6805. add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718)

          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk #398 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Common-trunk/398/ ) HADOOP-6805 . add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718 )
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #330 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Common-trunk-Commit/330/)
          HADOOP-6805. add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718)

          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #330 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Common-trunk-Commit/330/ ) HADOOP-6805 . add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718 )
          Hide
          Boris Shkolnik added a comment -

          moved utility method to SecurityUtil.java

          Show
          Boris Shkolnik added a comment - moved utility method to SecurityUtil.java
          Hide
          Boris Shkolnik added a comment -

          shouldn't. it is used as a key, so it just needs to be the same in both cases.

          Show
          Boris Shkolnik added a comment - shouldn't. it is used as a key, so it just needs to be the same in both cases.
          Hide
          Allen Wittenauer added a comment -

          Won't that break hosts that have multiple interfaces?

          Show
          Allen Wittenauer added a comment - Won't that break hosts that have multiple interfaces?
          Hide
          Boris Shkolnik added a comment -

          for previous version, not for commit

          Show
          Boris Shkolnik added a comment - for previous version, not for commit

            People

            • Assignee:
              Boris Shkolnik
              Reporter:
              Boris Shkolnik
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development