Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.22.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently, TokenStorage is a singleton. This doesn't work for some use cases, such as Oozie. I think that each Job should have a TokenStorage that is associated it.

      1. MAPREDUCE-1528.4.patch
        54 kB
        Jitendra Nath Pandey
      2. MAPREDUCE-1528.3.patch
        55 kB
        Jitendra Nath Pandey
      3. MAPREDUCE-1528.2.patch
        55 kB
        Jitendra Nath Pandey
      4. MAPREDUCE-1528.1.patch
        44 kB
        Jitendra Nath Pandey
      5. MAPREDUCE-1528_yhadoop20.patch
        49 kB
        Arun C Murthy
      6. MAPREDUCE-1528_yhadoop20.patch
        52 kB
        Arun C Murthy
      7. MAPREDUCE-1528_yhadoop20.patch
        53 kB
        Arun C Murthy
      8. MAPREDUCE-1528_yhadoop20.patch
        52 kB
        Arun C Murthy
      9. MAPREDUCE-1528_yhadoop20.patch
        60 kB
        Arun C Murthy
      10. MAPREDUCE-1528_yhadoop20.patch
        63 kB
        Arun C Murthy
      11. MAPREDUCE-1528_yhadoop20.patch
        66 kB
        Arun C Murthy

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          135d 22h 2m 1 Devaraj Das 09/Jul/10 20:28
          Resolved Resolved Closed Closed
          520d 9h 50m 1 Konstantin Shvachko 12/Dec/11 06:18
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/)

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/ )
          Devaraj Das made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Assignee Arun C Murthy [ acmurthy ] Jitendra Nath Pandey [ jnp ]
          Fix Version/s 0.22.0 [ 12314184 ]
          Resolution Fixed [ 1 ]
          Hide
          Devaraj Das added a comment -

          I just committed this. Thanks, Jitendra and Arun!

          Show
          Devaraj Das added a comment - I just committed this. Thanks, Jitendra and Arun!
          Hide
          Jitendra Nath Pandey added a comment -

          tests, javadoc, findbugs, javac warnings were run manually.

          Show
          Jitendra Nath Pandey added a comment - tests, javadoc, findbugs, javac warnings were run manually.
          Jitendra Nath Pandey made changes -
          Attachment MAPREDUCE-1528.4.patch [ 12449047 ]
          Hide
          Jitendra Nath Pandey added a comment -

          New patch addressing the comments.

          Show
          Jitendra Nath Pandey added a comment - New patch addressing the comments.
          Hide
          Devaraj Das added a comment -

          1) MiniMRCluster seems to have some unrelated changes
          2) The ClientProtocol's version should be bumped up.

          Show
          Devaraj Das added a comment - 1) MiniMRCluster seems to have some unrelated changes 2) The ClientProtocol's version should be bumped up.
          Jitendra Nath Pandey made changes -
          Attachment MAPREDUCE-1528.3.patch [ 12449044 ]
          Jitendra Nath Pandey made changes -
          Attachment MAPREDUCE-1528.2.patch [ 12449000 ]
          Hide
          Jitendra Nath Pandey added a comment -

          Added a test using the old mr api.

          Show
          Jitendra Nath Pandey added a comment - Added a test using the old mr api.
          Jitendra Nath Pandey made changes -
          Attachment MAPREDUCE-1528.1.patch [ 12448913 ]
          Hide
          Jitendra Nath Pandey added a comment -

          Patch for trunk added.

          Show
          Jitendra Nath Pandey added a comment - Patch for trunk added.
          Jitendra Nath Pandey made changes -
          Link This issue is blocked by HADOOP-6845 [ HADOOP-6845 ]
          Arun C Murthy made changes -
          Attachment MAPREDUCE-1528_yhadoop20.patch [ 12437339 ]
          Hide
          Arun C Murthy added a comment -

          Sigh, more merges!

          Show
          Arun C Murthy added a comment - Sigh, more merges!
          Arun C Murthy made changes -
          Attachment MAPREDUCE-1528_yhadoop20.patch [ 12437334 ]
          Hide
          Arun C Murthy added a comment -

          Updated patch, needed to merge more changes.

          Show
          Arun C Murthy added a comment - Updated patch, needed to merge more changes.
          Arun C Murthy made changes -
          Attachment MAPREDUCE-1528_yhadoop20.patch [ 12437314 ]
          Hide
          Arun C Murthy added a comment -

          Renamed TestTokenStorage to TestJobCredentials.

          Show
          Arun C Murthy added a comment - Renamed TestTokenStorage to TestJobCredentials.
          Arun C Murthy made changes -
          Attachment MAPREDUCE-1528_yhadoop20.patch [ 12437310 ]
          Hide
          Arun C Murthy added a comment -

          Pretty-fied patch.

          Show
          Arun C Murthy added a comment - Pretty-fied patch.
          Hide
          Owen O'Malley added a comment -

          Other than the commented out code, this looks fine for y20. +1

          Show
          Owen O'Malley added a comment - Other than the commented out code, this looks fine for y20. +1
          Arun C Murthy made changes -
          Attachment MAPREDUCE-1528_yhadoop20.patch [ 12437309 ]
          Hide
          Arun C Murthy added a comment -

          Uh, wrong patch previously...

          Show
          Arun C Murthy added a comment - Uh, wrong patch previously...
          Arun C Murthy made changes -
          Attachment MAPREDUCE-1528_yhadoop20.patch [ 12437308 ]
          Hide
          Arun C Murthy added a comment -

          Minor update to y20 branch.

          Show
          Arun C Murthy added a comment - Minor update to y20 branch.
          Arun C Murthy made changes -
          Assignee Arun C Murthy [ acmurthy ]
          Arun C Murthy made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-1528_yhadoop20.patch [ 12437307 ]
          Hide
          Arun C Murthy added a comment -

          Summary of changes:

          1. Renamed TokenStorage to Credentials to better reflect it's utility.
          2. Added a Credentials to JobConf (and an accessor: JobConf.getCredentials) since it's the only per-job identifier in an MR application for the old apis, added a JobContext.getCredentials for the new, context-objects api.
          3. Removed as much cruft as possible from TokenCache, without really going overboard - we need to keep TokenCache since it's Hadoop MapReduce specific and I can't really put everything into Credentials as it's in Hadoop Common.
          Show
          Arun C Murthy added a comment - Summary of changes: Renamed TokenStorage to Credentials to better reflect it's utility. Added a Credentials to JobConf (and an accessor: JobConf.getCredentials) since it's the only per-job identifier in an MR application for the old apis, added a JobContext.getCredentials for the new, context-objects api. Removed as much cruft as possible from TokenCache, without really going overboard - we need to keep TokenCache since it's Hadoop MapReduce specific and I can't really put everything into Credentials as it's in Hadoop Common.
          Owen O'Malley created issue -

            People

            • Assignee:
              Jitendra Nath Pandey
              Reporter:
              Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development