Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3727

jobtoken location property in jobconf refers to wrong jobtoken file

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0, 1.0.0
    • Fix Version/s: 0.23.1, 1.2.0
    • Component/s: security
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Oozie launcher job (for MR/Pig/Hive/Sqoop action) reads the location of the jobtoken file from the HADOOP_TOKEN_FILE_LOCATION ENV var and seeds it as the mapreduce.job.credentials.binary property in the jobconf that will be used to launch the real (MR/Pig/Hive/Sqoop) job.

      The MR/Pig/Hive/Sqoop submission code (via Hadoop job submission) uses correctly the injected mapreduce.job.credentials.binary property to load the credentials and submit their MR jobs.

      The problem is that the mapreduce.job.credentials.binary property also makes it to the tasks of the MR/Pig/Hive/Sqoop MR jobs.

      If for some reason the MR/Pig/Hive/Sqoop MR code does some logic that triggers the credential loading, because the property is set, the credential loading fails trying to load a jobtoken file of the launcher job which does not exists in the context of the MR/Pig/Hive/Sqoop jobs.

      More specifically, we are seeing this happening with certain hive queries that trigger a conditional code within their RowContainer which then uses the FileInputFormat.getSplits() and then the TokenCache tries to load credentials for a file that is for the wrong job.

      1. MAPREDUCE-3727-branch1.patch
        3 kB
        Alejandro Abdelnur
      2. MAPREDUCE-3727.patch
        4 kB
        Alejandro Abdelnur

        Issue Links

          Activity

          Alejandro Abdelnur created issue -
          Hide
          Alejandro Abdelnur added a comment -

          One possible solution would be the JobClient to remove this property before submitting the job.

          Show
          Alejandro Abdelnur added a comment - One possible solution would be the JobClient to remove this property before submitting the job.
          Hide
          Alejandro Abdelnur added a comment -

          still investigating if this affects trunk or not, code change significantly.

          Show
          Alejandro Abdelnur added a comment - still investigating if this affects trunk or not, code change significantly.
          Alejandro Abdelnur made changes -
          Field Original Value New Value
          Fix Version/s 1.1.0 [ 12317960 ]
          Hide
          Vinod Kumar Vavilapalli added a comment -

          This happens on trunk also. Clearly there is a TODO in the code which says the current place is inappropriate for reading the tokens file.

          If this code gets triggered, it is not just the reading of token file that will fail. Whenever this happens (don't know by what trigger), the client will try to obtain delegation tokens from the NameNode which will also fail? Have any clue why that isn't happening?

          One possible solution would be the JobClient to remove this property before submitting the job.

          I guess you mean as part of the individual Oozie actions. Right?

          The alternative could be to not fail with exception when it cannot read the file, but instead just log an error and continue. Not sure whether that's a good fix though.

          Show
          Vinod Kumar Vavilapalli added a comment - This happens on trunk also. Clearly there is a TODO in the code which says the current place is inappropriate for reading the tokens file. If this code gets triggered, it is not just the reading of token file that will fail. Whenever this happens (don't know by what trigger), the client will try to obtain delegation tokens from the NameNode which will also fail? Have any clue why that isn't happening? One possible solution would be the JobClient to remove this property before submitting the job. I guess you mean as part of the individual Oozie actions. Right? The alternative could be to not fail with exception when it cannot read the file, but instead just log an error and continue. Not sure whether that's a good fix though.
          Hide
          Alejandro Abdelnur added a comment -

          Vinod, thanks for confirming this is an issue in trunk as well.

          It is not possible to do it at Oozie level, the property is used within the scope of the hadoop submission code (by TokenCache, ie, computing splits), hadoop submission code should remove this property from the jobconf before writing the jobconf to hdfs.

          I guess a warn and continue would work too. but it would be quite confusing to get a warning for a file from some other jobtoken file.

          I think we should remove on submission (as I state before) as that property (current value) is meaningful only in the context the the current submission. If somebody is doing a submission from the submitted job (like Oozie), then they should start the whole cycle again (getting the ENV var and setting the property again in the context of the submitted job).

          Show
          Alejandro Abdelnur added a comment - Vinod, thanks for confirming this is an issue in trunk as well. It is not possible to do it at Oozie level, the property is used within the scope of the hadoop submission code (by TokenCache, ie, computing splits), hadoop submission code should remove this property from the jobconf before writing the jobconf to hdfs. I guess a warn and continue would work too. but it would be quite confusing to get a warning for a file from some other jobtoken file. I think we should remove on submission (as I state before) as that property (current value) is meaningful only in the context the the current submission. If somebody is doing a submission from the submitted job (like Oozie), then they should start the whole cycle again (getting the ENV var and setting the property again in the context of the submitted job).
          Alejandro Abdelnur made changes -
          Fix Version/s 0.23.1 [ 12318883 ]
          Affects Version/s 0.23.1 [ 12318883 ]
          Alejandro Abdelnur made changes -
          Attachment MAPREDUCE-3727.patch [ 12513027 ]
          Alejandro Abdelnur made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Tom White added a comment -

          +1 looks good to me.

          Show
          Tom White added a comment - +1 looks good to me.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12513027/MAPREDUCE-3727.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          -1 javadoc. The javadoc tool appears to have generated 1 warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1752//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1752//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12513027/MAPREDUCE-3727.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. -1 javadoc. The javadoc tool appears to have generated 1 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1752//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1752//console This message is automatically generated.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #1725 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1725/)
          MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1725 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1725/ ) MAPREDUCE-3727 . jobtoken location property in jobconf refers to wrong jobtoken file (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #1654 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1654/)
          MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1654 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1654/ ) MAPREDUCE-3727 . jobtoken location property in jobconf refers to wrong jobtoken file (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Commit #471 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/471/)
          Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #471 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/471/ ) Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-0.23-Commit #481 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/481/)
          Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #481 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/481/ ) Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Commit #494 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/494/)
          Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #494 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/494/ ) Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Alejandro Abdelnur made changes -
          Link This issue is blocked by HADOOP-8023 [ HADOOP-8023 ]
          Hide
          Alejandro Abdelnur added a comment -

          backporting it to branch-1.0 is blocked by HADOOP-8023

          Show
          Alejandro Abdelnur added a comment - backporting it to branch-1.0 is blocked by HADOOP-8023
          Hide
          Alejandro Abdelnur added a comment -

          patch for branch-1

          Show
          Alejandro Abdelnur added a comment - patch for branch-1
          Alejandro Abdelnur made changes -
          Attachment MAPREDUCE-3727-branch1.patch [ 12513213 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #1669 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1669/)
          MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1669 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1669/ ) MAPREDUCE-3727 . jobtoken location property in jobconf refers to wrong jobtoken file (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12513213/MAPREDUCE-3727-branch1.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1773//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12513213/MAPREDUCE-3727-branch1.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1773//console This message is automatically generated.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #946 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/946/)
          MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #946 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/946/ ) MAPREDUCE-3727 . jobtoken location property in jobconf refers to wrong jobtoken file (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #159 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/159/)
          Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #159 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/159/ ) Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Build #181 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/181/)
          Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #181 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/181/ ) Merge -r 1240409:1240410 from trunk to branch. FIXES: MAPREDUCE-3727 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240411 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #979 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/979/)
          MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)

          tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #979 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/979/ ) MAPREDUCE-3727 . jobtoken location property in jobconf refers to wrong jobtoken file (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240410 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/security/TokenCache.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/security/TestTokenCache.java
          Arun C Murthy made changes -
          Fix Version/s 0.24.0 [ 12317654 ]
          Fix Version/s 0.23.1 [ 12318883 ]
          Harsh J made changes -
          Fix Version/s 0.23.0 [ 12315570 ]
          Fix Version/s 0.24.0 [ 12317654 ]
          Fix Version/s 1.1.0 [ 12317960 ]
          Target Version/s 1.1.1 [ 12321660 ]
          Hide
          Harsh J added a comment -

          Affected was > Fixed.

          Show
          Harsh J added a comment - Affected was > Fixed.
          Harsh J made changes -
          Affects Version/s 0.23.0 [ 12315570 ]
          Affects Version/s 0.23.1 [ 12318883 ]
          Hide
          Harsh J added a comment -

          (Sorry, bad selection)

          Show
          Harsh J added a comment - (Sorry, bad selection)
          Harsh J made changes -
          Fix Version/s 0.23.1 [ 12318883 ]
          Fix Version/s 0.23.0 [ 12315570 ]
          Hide
          Alejandro Abdelnur added a comment -

          committed to branch-1

          Show
          Alejandro Abdelnur added a comment - committed to branch-1
          Alejandro Abdelnur made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Target Version/s 1.1.1 [ 12321660 ]
          Fix Version/s 1.2.0 [ 12321661 ]
          Resolution Fixed [ 1 ]
          Harsh J made changes -
          Link This issue is broken by MAPREDUCE-4324 [ MAPREDUCE-4324 ]
          Hide
          Matt Foley added a comment -

          Closed upon release of Hadoop 1.2.0.

          Show
          Matt Foley added a comment - Closed upon release of Hadoop 1.2.0.
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Alejandro Abdelnur
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development