Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12494

fetchdt stores the token based on token kind instead of token service

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None

      Description

      The fetchdt command stores the token in a file. However, the key of token is a token kind instead of a token service.

      1. HADOOP-12494
        0.8 kB
        HeeSoo Kim
      2. HADOOP-12494.patch
        0.8 kB
        HeeSoo Kim

        Activity

        Hide
        aw Allen Wittenauer added a comment -

        Owen O'Malley, you might want to look at this. Thanks.

        Show
        aw Allen Wittenauer added a comment - Owen O'Malley , you might want to look at this. Thanks.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 5s docker + precommit patch detected.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 2m 51s trunk passed
        +1 compile 0m 32s trunk passed with JDK v1.8.0_60
        +1 compile 0m 31s trunk passed with JDK v1.7.0_79
        +1 checkstyle 0m 15s trunk passed
        +1 mvneclipse 0m 14s trunk passed
        -1 findbugs 1m 55s hadoop-hdfs-project/hadoop-hdfs in trunk cannot run convertXmlToText from findbugs
        +1 javadoc 1m 7s trunk passed with JDK v1.8.0_60
        +1 javadoc 1m 45s trunk passed with JDK v1.7.0_79
        +1 mvninstall 0m 37s the patch passed
        +1 compile 0m 30s the patch passed with JDK v1.8.0_60
        +1 javac 0m 30s the patch passed
        +1 compile 0m 31s the patch passed with JDK v1.7.0_79
        +1 javac 0m 31s the patch passed
        +1 checkstyle 0m 14s the patch passed
        +1 mvneclipse 0m 13s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 3s the patch passed
        +1 javadoc 1m 6s the patch passed with JDK v1.8.0_60
        +1 javadoc 1m 48s the patch passed with JDK v1.7.0_79
        -1 unit 50m 24s hadoop-hdfs in the patch failed with JDK v1.8.0_60.
        -1 unit 50m 1s hadoop-hdfs in the patch failed with JDK v1.7.0_79.
        -1 asflicense 0m 19s Patch generated 56 ASF License warnings.
        119m 31s



        Reason Tests
        JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
          hadoop.hdfs.TestLeaseRecovery2
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
          hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
          hadoop.hdfs.server.blockmanagement.TestBlockManager
          hadoop.hdfs.server.namenode.TestRecoverStripedBlocks



        Subsystem Report/Notes
        Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-20
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12767682/HADOOP-12494.patch
        JIRA Issue HADOOP-12494
        Optional Tests asflicense javac javadoc mvninstall unit findbugs checkstyle compile
        uname Linux d60e034cad64 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build/patchprocess/apache-yetus-4ec64a8/dev-support/personality/hadoop.sh
        git revision trunk / 6c8b6f3
        Default Java 1.7.0_79
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79
        findbugs v3.0.0
        findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.html
        unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt
        unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        unit test logs https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-asflicense-problems.txt
        Max memory used 225MB
        Powered by Apache Yetus http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 5s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 2m 51s trunk passed +1 compile 0m 32s trunk passed with JDK v1.8.0_60 +1 compile 0m 31s trunk passed with JDK v1.7.0_79 +1 checkstyle 0m 15s trunk passed +1 mvneclipse 0m 14s trunk passed -1 findbugs 1m 55s hadoop-hdfs-project/hadoop-hdfs in trunk cannot run convertXmlToText from findbugs +1 javadoc 1m 7s trunk passed with JDK v1.8.0_60 +1 javadoc 1m 45s trunk passed with JDK v1.7.0_79 +1 mvninstall 0m 37s the patch passed +1 compile 0m 30s the patch passed with JDK v1.8.0_60 +1 javac 0m 30s the patch passed +1 compile 0m 31s the patch passed with JDK v1.7.0_79 +1 javac 0m 31s the patch passed +1 checkstyle 0m 14s the patch passed +1 mvneclipse 0m 13s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 3s the patch passed +1 javadoc 1m 6s the patch passed with JDK v1.8.0_60 +1 javadoc 1m 48s the patch passed with JDK v1.7.0_79 -1 unit 50m 24s hadoop-hdfs in the patch failed with JDK v1.8.0_60. -1 unit 50m 1s hadoop-hdfs in the patch failed with JDK v1.7.0_79. -1 asflicense 0m 19s Patch generated 56 ASF License warnings. 119m 31s Reason Tests JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery   hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.namenode.TestRecoverStripedBlocks Subsystem Report/Notes Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-20 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12767682/HADOOP-12494.patch JIRA Issue HADOOP-12494 Optional Tests asflicense javac javadoc mvninstall unit findbugs checkstyle compile uname Linux d60e034cad64 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build/patchprocess/apache-yetus-4ec64a8/dev-support/personality/hadoop.sh git revision trunk / 6c8b6f3 Default Java 1.7.0_79 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79 findbugs v3.0.0 findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.html unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/testReport/ asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/artifact/patchprocess/patch-asflicense-problems.txt Max memory used 225MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7898/console This message was automatically generated.
        Hide
        sookim HeeSoo Kim added a comment -

        The test failures are unrelated to the change made for this jira.

        Show
        sookim HeeSoo Kim added a comment - The test failures are unrelated to the change made for this jira.
        Hide
        aw Allen Wittenauer added a comment -

        +1 committing to trunk

        also removing the incompatible flag since the incompatibility was introduced in trunk.

        Show
        aw Allen Wittenauer added a comment - +1 committing to trunk also removing the incompatible flag since the incompatibility was introduced in trunk.
        Hide
        owen.omalley Owen O'Malley added a comment -

        +1

        Show
        owen.omalley Owen O'Malley added a comment - +1
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-trunk-Commit #8716 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8716/)
        HADOOP-12494. fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #8716 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8716/ ) HADOOP-12494 . fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2535 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2535/)
        HADOOP-12494. fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        • hadoop-common-project/hadoop-common/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2535 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2535/ ) HADOOP-12494 . fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java hadoop-common-project/hadoop-common/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #1328 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1328/)
        HADOOP-12494. fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1328 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1328/ ) HADOOP-12494 . fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #544 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/544/)
        HADOOP-12494. fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #544 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/544/ ) HADOOP-12494 . fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #605 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/605/)
        HADOOP-12494. fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #605 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/605/ ) HADOOP-12494 . fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #592 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/592/)
        HADOOP-12494. fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #592 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/592/ ) HADOOP-12494 . fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2482 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2482/)
        HADOOP-12494. fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java
        • hadoop-common-project/hadoop-common/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2482 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2482/ ) HADOOP-12494 . fetchdt stores the token based on token kind instead of (aw: rev 1396867b52533ecf894158a464c6cd3abc7041b9) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DelegationTokenFetcher.java hadoop-common-project/hadoop-common/CHANGES.txt

          People

          • Assignee:
            sookim HeeSoo Kim
            Reporter:
            sookim HeeSoo Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development