Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-949

Move Delegation token into Common so that we can use it for MapReduce also

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: security
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We need to support a MapReduce job that launches another MapReduce job inside its Mapper. Since the task doesn't have any Kerberos tickets, we need a delegation token. Moving the HDFS Delegation token to Common will allow both projects to use it.

      1. 6547-949-1470-0_20.1.patch
        86 kB
        Jitendra Nath Pandey
      2. h-949.patch
        51 kB
        Owen O'Malley
      3. h-949.patch
        51 kB
        Owen O'Malley
      4. h-949.patch
        36 kB
        Owen O'Malley
      5. h-949-common.patch
        25 kB
        Owen O'Malley
      6. h-949-common.patch
        22 kB
        Owen O'Malley

        Issue Links

          Activity

          Owen O'Malley created issue -
          Owen O'Malley made changes -
          Field Original Value New Value
          Component/s security [ 12313400 ]
          Hide
          Owen O'Malley added a comment -

          This patch splits the HDFS delegation token classes into reusable parts and moves them into common.

          Show
          Owen O'Malley added a comment - This patch splits the HDFS delegation token classes into reusable parts and moves them into common.
          Owen O'Malley made changes -
          Attachment h-949.patch [ 12435180 ]
          Attachment h-949-common.patch [ 12435181 ]
          Hide
          Devaraj Das added a comment -

          This looks good. I will create a jira for common..

          Show
          Devaraj Das added a comment - This looks good. I will create a jira for common..
          Devaraj Das made changes -
          Link This issue is blocked by HADOOP-6547 [ HADOOP-6547 ]
          Hide
          Owen O'Malley added a comment -

          New versions of the patches. The test case in common doesn't work yet.

          Show
          Owen O'Malley added a comment - New versions of the patches. The test case in common doesn't work yet.
          Owen O'Malley made changes -
          Attachment h-949.patch [ 12435212 ]
          Attachment h-949-common.patch [ 12435213 ]
          Owen O'Malley made changes -
          Link This issue blocks MAPREDUCE-1470 [ MAPREDUCE-1470 ]
          Hide
          Owen O'Malley added a comment -

          Updates the patch to use the AbstractDelegationToken names from Common.

          Show
          Owen O'Malley added a comment - Updates the patch to use the AbstractDelegationToken names from Common.
          Owen O'Malley made changes -
          Attachment h-949.patch [ 12435264 ]
          Hide
          Owen O'Malley added a comment -

          The hdfs tests pass and findbugs came back clean after we removed the shadowing by renaming the Common classes to AbstractDelegation...

          Show
          Owen O'Malley added a comment - The hdfs tests pass and findbugs came back clean after we removed the shadowing by renaming the Common classes to AbstractDelegation...
          Hide
          Devaraj Das added a comment -

          +1 on the patch

          Show
          Devaraj Das added a comment - +1 on the patch
          Hide
          Owen O'Malley added a comment -

          I just committed this.

          Show
          Owen O'Malley added a comment - I just committed this.
          Owen O'Malley made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.22.0 [ 12314241 ]
          Resolution Fixed [ 1 ]
          Hide
          Jitendra Nath Pandey added a comment -

          Combined patch for HADOOP-6547, HDFS-949, MAPREDUCE-1470 for hadoop-20.

          Show
          Jitendra Nath Pandey added a comment - Combined patch for HADOOP-6547 , HDFS-949 , MAPREDUCE-1470 for hadoop-20.
          Jitendra Nath Pandey made changes -
          Attachment 6547-949-1470-0_20.1.patch [ 12435271 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #191 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/191/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #191 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/191/ )
          Hide
          Hudson added a comment -

          Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #146 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/146/)

          Show
          Hudson added a comment - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #146 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/146/ )
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #275 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/275/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #275 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/275/ )
          Tom White made changes -
          Fix Version/s 0.21.0 [ 12314046 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          5d 8h 1 Owen O'Malley 09/Feb/10 08:30
          Resolved Resolved Closed Closed
          196d 12h 20m 1 Tom White 24/Aug/10 21:51

            People

            • Assignee:
              Owen O'Malley
              Reporter:
              Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development