Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-949

Move Delegation token into Common so that we can use it for MapReduce also

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: security
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We need to support a MapReduce job that launches another MapReduce job inside its Mapper. Since the task doesn't have any Kerberos tickets, we need a delegation token. Moving the HDFS Delegation token to Common will allow both projects to use it.

      1. 6547-949-1470-0_20.1.patch
        86 kB
        Jitendra Nath Pandey
      2. h-949.patch
        51 kB
        Owen O'Malley
      3. h-949-common.patch
        25 kB
        Owen O'Malley
      4. h-949.patch
        51 kB
        Owen O'Malley
      5. h-949-common.patch
        22 kB
        Owen O'Malley
      6. h-949.patch
        36 kB
        Owen O'Malley

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #275 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/275/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #275 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/275/ )
          Hide
          Hudson added a comment -

          Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #146 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/146/)

          Show
          Hudson added a comment - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #146 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/146/ )
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #191 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/191/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #191 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/191/ )
          Hide
          Jitendra Nath Pandey added a comment -

          Combined patch for HADOOP-6547, HDFS-949, MAPREDUCE-1470 for hadoop-20.

          Show
          Jitendra Nath Pandey added a comment - Combined patch for HADOOP-6547 , HDFS-949 , MAPREDUCE-1470 for hadoop-20.
          Hide
          Owen O'Malley added a comment -

          I just committed this.

          Show
          Owen O'Malley added a comment - I just committed this.
          Hide
          Devaraj Das added a comment -

          +1 on the patch

          Show
          Devaraj Das added a comment - +1 on the patch
          Hide
          Owen O'Malley added a comment -

          The hdfs tests pass and findbugs came back clean after we removed the shadowing by renaming the Common classes to AbstractDelegation...

          Show
          Owen O'Malley added a comment - The hdfs tests pass and findbugs came back clean after we removed the shadowing by renaming the Common classes to AbstractDelegation...
          Hide
          Owen O'Malley added a comment -

          Updates the patch to use the AbstractDelegationToken names from Common.

          Show
          Owen O'Malley added a comment - Updates the patch to use the AbstractDelegationToken names from Common.
          Hide
          Owen O'Malley added a comment -

          New versions of the patches. The test case in common doesn't work yet.

          Show
          Owen O'Malley added a comment - New versions of the patches. The test case in common doesn't work yet.
          Hide
          Devaraj Das added a comment -

          This looks good. I will create a jira for common..

          Show
          Devaraj Das added a comment - This looks good. I will create a jira for common..
          Hide
          Owen O'Malley added a comment -

          This patch splits the HDFS delegation token classes into reusable parts and moves them into common.

          Show
          Owen O'Malley added a comment - This patch splits the HDFS delegation token classes into reusable parts and moves them into common.

            People

            • Assignee:
              Owen O'Malley
              Reporter:
              Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development