Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1718

job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.22.0
    • Component/s: None
    • Labels:
      None
    • Tags:
      security

      Description

      the key (build in TokenCache) is hdfs.service.host_HOSTNAME.PORT, but
      in HftpFileSystem it is sometimes built as hdfs.service.host_IP.PORT.

      Fix. change it to always be IP.

      1. MAPREDUCE-1718-2.patch
        12 kB
        Boris Shkolnik
      2. MAPREDUCE-1718-3.patch
        12 kB
        Boris Shkolnik
      3. MAPREDUCE-1718-4.patch
        13 kB
        Boris Shkolnik
      4. MAPREDUCE-1718-4.patch
        13 kB
        Boris Shkolnik
      5. MAPREDUCE-1718-BP20-1.patch
        3 kB
        Boris Shkolnik
      6. MAPREDUCE-1718-BP20-2.patch
        9 kB
        Boris Shkolnik

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          89d 23h 35m 1 Boris Shkolnik 21/Jul/10 01:02
          Patch Available Patch Available Resolved Resolved
          2d 22h 55m 1 Devaraj Das 23/Jul/10 23:57
          Resolved Resolved Closed Closed
          506d 7h 22m 1 Konstantin Shvachko 12/Dec/11 06:19
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/)

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/ )
          Devaraj Das made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.22.0 [ 12314184 ]
          Resolution Fixed [ 1 ]
          Hide
          Devaraj Das added a comment -

          I just committed this. Thanks, Boris!

          Show
          Devaraj Das added a comment - I just committed this. Thanks, Boris!
          Boris Shkolnik made changes -
          Attachment MAPREDUCE-1718-4.patch [ 12450366 ]
          Hide
          Boris Shkolnik added a comment -

          merged with trunk.
          Ran tests all passed (except TestRumenJobTraces - see MAPREDUCE-1925)

          Show
          Boris Shkolnik added a comment - merged with trunk. Ran tests all passed (except TestRumenJobTraces - see MAPREDUCE-1925 )
          Boris Shkolnik made changes -
          Attachment MAPREDUCE-1718-4.patch [ 12450344 ]
          Hide
          Boris Shkolnik added a comment -

          merged with the trunk.
          modified test to verify value set in conf .

          Show
          Boris Shkolnik added a comment - merged with the trunk. modified test to verify value set in conf .
          Boris Shkolnik made changes -
          Attachment MAPREDUCE-1718-3.patch [ 12450247 ]
          Boris Shkolnik made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Boris Shkolnik made changes -
          Attachment MAPREDUCE-1718-2.patch [ 12450003 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk #398 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Common-trunk/398/)
          HADOOP-6805. add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718)

          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk #398 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Common-trunk/398/ ) HADOOP-6805 . add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718 )
          Boris Shkolnik made changes -
          Link This issue incorporates HDFS-1308 [ HDFS-1308 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #330 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Common-trunk-Commit/330/)
          HADOOP-6805. add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718)

          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #330 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Common-trunk-Commit/330/ ) HADOOP-6805 . add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718 )
          Boris Shkolnik made changes -
          Link This issue incorporates HADOOP-6805 [ HADOOP-6805 ]
          Boris Shkolnik made changes -
          Attachment MAPREDUCE-1718-BP20-2.patch [ 12442726 ]
          Hide
          Boris Shkolnik added a comment -

          moved utility method to SecurityUtil.java

          Show
          Boris Shkolnik added a comment - moved utility method to SecurityUtil.java
          Hide
          Boris Shkolnik added a comment -

          shouldn't. it is used as a key, so it just needs to be the same in both cases.

          Show
          Boris Shkolnik added a comment - shouldn't. it is used as a key, so it just needs to be the same in both cases.
          Hide
          Allen Wittenauer added a comment -

          Won't that break hosts that have multiple interfaces?

          Show
          Allen Wittenauer added a comment - Won't that break hosts that have multiple interfaces?
          Boris Shkolnik made changes -
          Attachment MAPREDUCE-1718-BP20-1.patch [ 12442494 ]
          Hide
          Boris Shkolnik added a comment -

          for previous version, not for commit

          Show
          Boris Shkolnik added a comment - for previous version, not for commit
          Boris Shkolnik made changes -
          Field Original Value New Value
          Assignee Boris Shkolnik [ boryas ]
          Boris Shkolnik created issue -

            People

            • Assignee:
              Boris Shkolnik
              Reporter:
              Boris Shkolnik
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development