Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14412

HostsFileReader#getHostDetails is very expensive on large clusters

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha4, 2.8.2
    • Component/s: util
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      After upgrading one of our large clusters to 2.8 we noticed many IPC server threads of the resourcemanager spending time in NodesListManager#isValidNode which in turn was calling HostsFileReader#getHostDetails. The latter is creating complete copies of the include and exclude sets for every node heartbeat, and these sets are not small due to the size of the cluster. These copies are causing multiple resizes of the underlying HashSets being filled and creating lots of garbage.

      1. HADOOP-14412-branch-2.8.002.patch
        16 kB
        Jason Lowe
      2. HADOOP-14412-branch-2.002.patch
        18 kB
        Jason Lowe
      3. HADOOP-14412-branch-2.002.patch
        18 kB
        Jason Lowe
      4. HADOOP-14412-branch-2.001.patch
        18 kB
        Jason Lowe
      5. HADOOP-14412.002.patch
        18 kB
        Jason Lowe
      6. HADOOP-14412.001.patch
        18 kB
        Jason Lowe

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11741 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11741/)
          HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large (rohithsharmaks: rev d87a63a9019d74a1c338c724e050952843a153e5)

          • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/NodesListManager.java
          • (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestHostsFileReader.java
          • (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/HostsFileReader.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11741 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11741/ ) HADOOP-14412 . HostsFileReader#getHostDetails is very expensive on large (rohithsharmaks: rev d87a63a9019d74a1c338c724e050952843a153e5) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/NodesListManager.java (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestHostsFileReader.java (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/HostsFileReader.java
          Hide
          rohithsharma Rohith Sharma K S added a comment -

          committed to trunk/branch-2/branch-2.8. thanks Jason for the patch!

          Show
          rohithsharma Rohith Sharma K S added a comment - committed to trunk/branch-2/branch-2.8. thanks Jason for the patch!
          Hide
          rohithsharma Rohith Sharma K S added a comment -

          committing shortly

          Show
          rohithsharma Rohith Sharma K S added a comment - committing shortly
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 13m 48s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          0 mvndep 1m 42s Maven dependency ordering for branch
          +1 mvninstall 8m 37s branch-2 passed
          +1 compile 7m 1s branch-2 passed with JDK v1.8.0_131
          +1 compile 7m 23s branch-2 passed with JDK v1.7.0_131
          +1 checkstyle 1m 34s branch-2 passed
          +1 mvnsite 1m 45s branch-2 passed
          +1 mvneclipse 0m 36s branch-2 passed
          +1 findbugs 3m 2s branch-2 passed
          +1 javadoc 1m 8s branch-2 passed with JDK v1.8.0_131
          +1 javadoc 1m 22s branch-2 passed with JDK v1.7.0_131
          0 mvndep 0m 17s Maven dependency ordering for patch
          +1 mvninstall 1m 25s the patch passed
          +1 compile 7m 4s the patch passed with JDK v1.8.0_131
          +1 javac 7m 4s the patch passed
          +1 compile 7m 39s the patch passed with JDK v1.7.0_131
          +1 javac 7m 39s the patch passed
          -0 checkstyle 1m 43s root: The patch generated 1 new + 24 unchanged - 2 fixed = 25 total (was 26)
          +1 mvnsite 1m 56s the patch passed
          +1 mvneclipse 0m 43s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 3m 57s the patch passed
          +1 javadoc 1m 24s the patch passed with JDK v1.8.0_131
          +1 javadoc 1m 25s the patch passed with JDK v1.7.0_131
          +1 unit 8m 47s hadoop-common in the patch passed with JDK v1.7.0_131.
          -1 unit 41m 59s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_131.
          +1 asflicense 0m 32s The patch does not generate ASF License warnings.
          199m 26s



          Reason Tests
          JDK v1.7.0_131 Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:8515d35
          JIRA Issue HADOOP-14412
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12868315/HADOOP-14412-branch-2.002.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 93ecb0ebf287 3.13.0-107-generic #154-Ubuntu SMP Tue Dec 20 09:57:27 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision branch-2 / da7c900
          Default Java 1.7.0_131
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_131 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_131
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12335/artifact/patchprocess/diff-checkstyle-root.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12335/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_131.txt
          JDK v1.7.0_131 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12335/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12335/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 13m 48s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 1m 42s Maven dependency ordering for branch +1 mvninstall 8m 37s branch-2 passed +1 compile 7m 1s branch-2 passed with JDK v1.8.0_131 +1 compile 7m 23s branch-2 passed with JDK v1.7.0_131 +1 checkstyle 1m 34s branch-2 passed +1 mvnsite 1m 45s branch-2 passed +1 mvneclipse 0m 36s branch-2 passed +1 findbugs 3m 2s branch-2 passed +1 javadoc 1m 8s branch-2 passed with JDK v1.8.0_131 +1 javadoc 1m 22s branch-2 passed with JDK v1.7.0_131 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 1m 25s the patch passed +1 compile 7m 4s the patch passed with JDK v1.8.0_131 +1 javac 7m 4s the patch passed +1 compile 7m 39s the patch passed with JDK v1.7.0_131 +1 javac 7m 39s the patch passed -0 checkstyle 1m 43s root: The patch generated 1 new + 24 unchanged - 2 fixed = 25 total (was 26) +1 mvnsite 1m 56s the patch passed +1 mvneclipse 0m 43s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 57s the patch passed +1 javadoc 1m 24s the patch passed with JDK v1.8.0_131 +1 javadoc 1m 25s the patch passed with JDK v1.7.0_131 +1 unit 8m 47s hadoop-common in the patch passed with JDK v1.7.0_131. -1 unit 41m 59s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_131. +1 asflicense 0m 32s The patch does not generate ASF License warnings. 199m 26s Reason Tests JDK v1.7.0_131 Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler Subsystem Report/Notes Docker Image:yetus/hadoop:8515d35 JIRA Issue HADOOP-14412 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12868315/HADOOP-14412-branch-2.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 93ecb0ebf287 3.13.0-107-generic #154-Ubuntu SMP Tue Dec 20 09:57:27 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2 / da7c900 Default Java 1.7.0_131 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_131 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_131 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12335/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12335/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_131.txt JDK v1.7.0_131 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12335/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12335/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jlowe Jason Lowe added a comment -

          Uploading the same branch-2 patch again to trigger a Jenkins run.

          Show
          jlowe Jason Lowe added a comment - Uploading the same branch-2 patch again to trigger a Jenkins run.
          Hide
          rohithsharma Rohith Sharma K S added a comment -

          I will commit trunk patch later of today if no more objections.
          Branch-2-v2 patch jenkins has not triggered.
          Branch-2.8 patch looks good to me.

          Show
          rohithsharma Rohith Sharma K S added a comment - I will commit trunk patch later of today if no more objections. Branch-2-v2 patch jenkins has not triggered. Branch-2.8 patch looks good to me.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 13m 45s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 2 new or modified test files.
          0 mvndep 0m 14s Maven dependency ordering for branch
          +1 mvninstall 8m 46s branch-2.8 passed
          +1 compile 6m 10s branch-2.8 passed with JDK v1.8.0_131
          +1 compile 6m 57s branch-2.8 passed with JDK v1.7.0_121
          +1 checkstyle 0m 56s branch-2.8 passed
          +1 mvnsite 1m 28s branch-2.8 passed
          +1 mvneclipse 0m 27s branch-2.8 passed
          +1 findbugs 2m 38s branch-2.8 passed
          +1 javadoc 0m 58s branch-2.8 passed with JDK v1.8.0_131
          +1 javadoc 1m 11s branch-2.8 passed with JDK v1.7.0_121
          0 mvndep 0m 15s Maven dependency ordering for patch
          +1 mvninstall 1m 13s the patch passed
          +1 compile 5m 41s the patch passed with JDK v1.8.0_131
          +1 javac 5m 41s the patch passed
          +1 compile 7m 8s the patch passed with JDK v1.7.0_121
          +1 javac 7m 8s the patch passed
          +1 checkstyle 1m 19s root: The patch generated 0 new + 16 unchanged - 2 fixed = 16 total (was 18)
          +1 mvnsite 1m 44s the patch passed
          +1 mvneclipse 0m 42s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 3m 2s the patch passed
          +1 javadoc 1m 4s the patch passed with JDK v1.8.0_131
          +1 javadoc 1m 10s the patch passed with JDK v1.7.0_121
          +1 unit 7m 38s hadoop-common in the patch passed with JDK v1.7.0_121.
          -1 unit 76m 22s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_121.
          +1 asflicense 0m 30s The patch does not generate ASF License warnings.
          260m 59s



          Reason Tests
          JDK v1.8.0_131 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens
            hadoop.yarn.server.resourcemanager.TestAMAuthorization
          JDK v1.7.0_121 Failed junit tests hadoop.yarn.server.resourcemanager.monitor.TestSchedulingMonitor
            hadoop.yarn.server.resourcemanager.TestClientRMTokens
            hadoop.yarn.server.resourcemanager.TestAMAuthorization



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:5970e82
          JIRA Issue HADOOP-14412
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12868176/HADOOP-14412-branch-2.8.002.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux a606a977c658 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision branch-2.8 / c992cf6
          Default Java 1.7.0_121
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_131 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_121
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12322/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_121.txt
          JDK v1.7.0_121 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12322/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12322/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 13m 45s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 2 new or modified test files. 0 mvndep 0m 14s Maven dependency ordering for branch +1 mvninstall 8m 46s branch-2.8 passed +1 compile 6m 10s branch-2.8 passed with JDK v1.8.0_131 +1 compile 6m 57s branch-2.8 passed with JDK v1.7.0_121 +1 checkstyle 0m 56s branch-2.8 passed +1 mvnsite 1m 28s branch-2.8 passed +1 mvneclipse 0m 27s branch-2.8 passed +1 findbugs 2m 38s branch-2.8 passed +1 javadoc 0m 58s branch-2.8 passed with JDK v1.8.0_131 +1 javadoc 1m 11s branch-2.8 passed with JDK v1.7.0_121 0 mvndep 0m 15s Maven dependency ordering for patch +1 mvninstall 1m 13s the patch passed +1 compile 5m 41s the patch passed with JDK v1.8.0_131 +1 javac 5m 41s the patch passed +1 compile 7m 8s the patch passed with JDK v1.7.0_121 +1 javac 7m 8s the patch passed +1 checkstyle 1m 19s root: The patch generated 0 new + 16 unchanged - 2 fixed = 16 total (was 18) +1 mvnsite 1m 44s the patch passed +1 mvneclipse 0m 42s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 2s the patch passed +1 javadoc 1m 4s the patch passed with JDK v1.8.0_131 +1 javadoc 1m 10s the patch passed with JDK v1.7.0_121 +1 unit 7m 38s hadoop-common in the patch passed with JDK v1.7.0_121. -1 unit 76m 22s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_121. +1 asflicense 0m 30s The patch does not generate ASF License warnings. 260m 59s Reason Tests JDK v1.8.0_131 Failed junit tests hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestAMAuthorization JDK v1.7.0_121 Failed junit tests hadoop.yarn.server.resourcemanager.monitor.TestSchedulingMonitor   hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestAMAuthorization Subsystem Report/Notes Docker Image:yetus/hadoop:5970e82 JIRA Issue HADOOP-14412 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12868176/HADOOP-14412-branch-2.8.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux a606a977c658 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.8 / c992cf6 Default Java 1.7.0_121 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_131 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_121 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12322/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_121.txt JDK v1.7.0_121 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12322/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12322/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jlowe Jason Lowe added a comment -

          And the corresponding patch for branch-2.8.

          Show
          jlowe Jason Lowe added a comment - And the corresponding patch for branch-2.8.
          Hide
          jlowe Jason Lowe added a comment -

          The last checkstyle issue is asking to put a period on something that isn't a sentence, so I'm ignoring that one. The unit test failures appear to be unrelated.

          Uploading an equivalent patch for branch-2.

          Show
          jlowe Jason Lowe added a comment - The last checkstyle issue is asking to put a period on something that isn't a sentence, so I'm ignoring that one. The unit test failures appear to be unrelated. Uploading an equivalent patch for branch-2.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 16m 19s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          0 mvndep 1m 50s Maven dependency ordering for branch
          +1 mvninstall 14m 2s trunk passed
          +1 compile 14m 13s trunk passed
          +1 checkstyle 1m 56s trunk passed
          +1 mvnsite 1m 48s trunk passed
          +1 mvneclipse 0m 45s trunk passed
          -1 findbugs 1m 29s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings.
          +1 javadoc 1m 21s trunk passed
          0 mvndep 0m 17s Maven dependency ordering for patch
          +1 mvninstall 1m 18s the patch passed
          +1 compile 12m 43s the patch passed
          +1 javac 12m 43s the patch passed
          -0 checkstyle 1m 58s root: The patch generated 1 new + 26 unchanged - 2 fixed = 27 total (was 28)
          +1 mvnsite 2m 5s the patch passed
          +1 mvneclipse 0m 47s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 3m 28s the patch passed
          +1 javadoc 1m 28s the patch passed
          -1 unit 9m 5s hadoop-common in the patch failed.
          -1 unit 40m 23s hadoop-yarn-server-resourcemanager in the patch failed.
          +1 asflicense 0m 47s The patch does not generate ASF License warnings.
          153m 4s



          Reason Tests
          Failed junit tests hadoop.fs.sftp.TestSFTPFileSystem
            hadoop.yarn.server.resourcemanager.TestRMRestart



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue HADOOP-14412
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12868118/HADOOP-14412.002.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 8df0076b79d3 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / c48f297
          Default Java 1.8.0_131
          findbugs v3.1.0-RC1
          findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html
          checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/artifact/patchprocess/diff-checkstyle-root.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 16m 19s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 1m 50s Maven dependency ordering for branch +1 mvninstall 14m 2s trunk passed +1 compile 14m 13s trunk passed +1 checkstyle 1m 56s trunk passed +1 mvnsite 1m 48s trunk passed +1 mvneclipse 0m 45s trunk passed -1 findbugs 1m 29s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings. +1 javadoc 1m 21s trunk passed 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 1m 18s the patch passed +1 compile 12m 43s the patch passed +1 javac 12m 43s the patch passed -0 checkstyle 1m 58s root: The patch generated 1 new + 26 unchanged - 2 fixed = 27 total (was 28) +1 mvnsite 2m 5s the patch passed +1 mvneclipse 0m 47s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 28s the patch passed +1 javadoc 1m 28s the patch passed -1 unit 9m 5s hadoop-common in the patch failed. -1 unit 40m 23s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 47s The patch does not generate ASF License warnings. 153m 4s Reason Tests Failed junit tests hadoop.fs.sftp.TestSFTPFileSystem   hadoop.yarn.server.resourcemanager.TestRMRestart Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HADOOP-14412 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12868118/HADOOP-14412.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 8df0076b79d3 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / c48f297 Default Java 1.8.0_131 findbugs v3.1.0-RC1 findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12316/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 18m 21s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          0 mvndep 1m 41s Maven dependency ordering for branch
          +1 mvninstall 8m 9s branch-2 passed
          +1 compile 5m 26s branch-2 passed with JDK v1.8.0_131
          +1 compile 6m 21s branch-2 passed with JDK v1.7.0_121
          +1 checkstyle 1m 14s branch-2 passed
          +1 mvnsite 1m 30s branch-2 passed
          +1 mvneclipse 0m 26s branch-2 passed
          +1 findbugs 2m 43s branch-2 passed
          +1 javadoc 1m 4s branch-2 passed with JDK v1.8.0_131
          +1 javadoc 1m 10s branch-2 passed with JDK v1.7.0_121
          0 mvndep 0m 14s Maven dependency ordering for patch
          +1 mvninstall 1m 10s the patch passed
          +1 compile 5m 57s the patch passed with JDK v1.8.0_131
          +1 javac 5m 57s the patch passed
          +1 compile 6m 36s the patch passed with JDK v1.7.0_121
          +1 javac 6m 36s the patch passed
          -0 checkstyle 1m 24s root: The patch generated 9 new + 24 unchanged - 2 fixed = 33 total (was 26)
          +1 mvnsite 1m 42s the patch passed
          +1 mvneclipse 0m 43s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 3m 24s the patch passed
          +1 javadoc 1m 16s the patch passed with JDK v1.8.0_131
          +1 javadoc 1m 28s the patch passed with JDK v1.7.0_121
          +1 unit 13m 41s hadoop-common in the patch passed with JDK v1.7.0_121.
          -1 unit 41m 29s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_121.
          +1 asflicense 0m 27s The patch does not generate ASF License warnings.
          202m 50s



          Reason Tests
          JDK v1.7.0_121 Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.server.resourcemanager.monitor.TestSchedulingMonitor
            hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler
            hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:8515d35
          JIRA Issue HADOOP-14412
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12868093/HADOOP-14412-branch-2.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 405c21eae9d2 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision branch-2 / d370edc
          Default Java 1.7.0_121
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_131 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_121
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12313/artifact/patchprocess/diff-checkstyle-root.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12313/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_121.txt
          JDK v1.7.0_121 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12313/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12313/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 18m 21s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 1m 41s Maven dependency ordering for branch +1 mvninstall 8m 9s branch-2 passed +1 compile 5m 26s branch-2 passed with JDK v1.8.0_131 +1 compile 6m 21s branch-2 passed with JDK v1.7.0_121 +1 checkstyle 1m 14s branch-2 passed +1 mvnsite 1m 30s branch-2 passed +1 mvneclipse 0m 26s branch-2 passed +1 findbugs 2m 43s branch-2 passed +1 javadoc 1m 4s branch-2 passed with JDK v1.8.0_131 +1 javadoc 1m 10s branch-2 passed with JDK v1.7.0_121 0 mvndep 0m 14s Maven dependency ordering for patch +1 mvninstall 1m 10s the patch passed +1 compile 5m 57s the patch passed with JDK v1.8.0_131 +1 javac 5m 57s the patch passed +1 compile 6m 36s the patch passed with JDK v1.7.0_121 +1 javac 6m 36s the patch passed -0 checkstyle 1m 24s root: The patch generated 9 new + 24 unchanged - 2 fixed = 33 total (was 26) +1 mvnsite 1m 42s the patch passed +1 mvneclipse 0m 43s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 24s the patch passed +1 javadoc 1m 16s the patch passed with JDK v1.8.0_131 +1 javadoc 1m 28s the patch passed with JDK v1.7.0_121 +1 unit 13m 41s hadoop-common in the patch passed with JDK v1.7.0_121. -1 unit 41m 29s hadoop-yarn-server-resourcemanager in the patch failed with JDK v1.7.0_121. +1 asflicense 0m 27s The patch does not generate ASF License warnings. 202m 50s Reason Tests JDK v1.7.0_121 Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.monitor.TestSchedulingMonitor   hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer Subsystem Report/Notes Docker Image:yetus/hadoop:8515d35 JIRA Issue HADOOP-14412 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12868093/HADOOP-14412-branch-2.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 405c21eae9d2 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2 / d370edc Default Java 1.7.0_121 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_131 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_121 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12313/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12313/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-jdk1.7.0_121.txt JDK v1.7.0_121 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12313/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12313/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jlowe Jason Lowe added a comment -

          A new trunk patch version that should address the checkstyle issues.

          Show
          jlowe Jason Lowe added a comment - A new trunk patch version that should address the checkstyle issues.
          Hide
          jlowe Jason Lowe added a comment -

          Thanks for the review, Rohith! Here's a patch for branch-2 which is needed to fix a few JDK8-isms in the trunk patch. I'll followup shortly with a branch-2.8 patch which is needed to fix a unit tests that broke with this change in that branch.

          Show
          jlowe Jason Lowe added a comment - Thanks for the review, Rohith! Here's a patch for branch-2 which is needed to fix a few JDK8-isms in the trunk patch. I'll followup shortly with a branch-2.8 patch which is needed to fix a unit tests that broke with this change in that branch.
          Hide
          rohithsharma Rohith Sharma K S added a comment -

          Thanks Jason for finding this issue. I am +1 for using AtomicReference and for the patch. It looks cleaner and better solution now.

          Show
          rohithsharma Rohith Sharma K S added a comment - Thanks Jason for finding this issue. I am +1 for using AtomicReference and for the patch. It looks cleaner and better solution now.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 26s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          0 mvndep 1m 32s Maven dependency ordering for branch
          +1 mvninstall 14m 1s trunk passed
          +1 compile 17m 6s trunk passed
          +1 checkstyle 1m 57s trunk passed
          +1 mvnsite 1m 55s trunk passed
          +1 mvneclipse 0m 44s trunk passed
          -1 findbugs 1m 31s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings.
          +1 javadoc 1m 24s trunk passed
          0 mvndep 0m 16s Maven dependency ordering for patch
          +1 mvninstall 1m 21s the patch passed
          +1 compile 15m 29s the patch passed
          +1 javac 15m 29s the patch passed
          -0 checkstyle 3m 3s root: The patch generated 7 new + 26 unchanged - 2 fixed = 33 total (was 28)
          +1 mvnsite 2m 10s the patch passed
          +1 mvneclipse 0m 52s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 findbugs 3m 1s the patch passed
          +1 javadoc 1m 26s the patch passed
          +1 unit 9m 5s hadoop-common in the patch passed.
          -1 unit 44m 21s hadoop-yarn-server-resourcemanager in the patch failed.
          +1 asflicense 0m 44s The patch does not generate ASF License warnings.
          148m 3s



          Reason Tests
          Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer
            hadoop.yarn.server.resourcemanager.TestRMRestart
          Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA
            org.apache.hadoop.yarn.server.resourcemanager.TestKillApplicationWithRMHA



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue HADOOP-14412
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12867664/HADOOP-14412.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux fce2e2c3b875 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 0d5c8ed
          Default Java 1.8.0_121
          findbugs v3.1.0-RC1
          findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html
          checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/artifact/patchprocess/diff-checkstyle-root.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 26s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 1m 32s Maven dependency ordering for branch +1 mvninstall 14m 1s trunk passed +1 compile 17m 6s trunk passed +1 checkstyle 1m 57s trunk passed +1 mvnsite 1m 55s trunk passed +1 mvneclipse 0m 44s trunk passed -1 findbugs 1m 31s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings. +1 javadoc 1m 24s trunk passed 0 mvndep 0m 16s Maven dependency ordering for patch +1 mvninstall 1m 21s the patch passed +1 compile 15m 29s the patch passed +1 javac 15m 29s the patch passed -0 checkstyle 3m 3s root: The patch generated 7 new + 26 unchanged - 2 fixed = 33 total (was 28) +1 mvnsite 2m 10s the patch passed +1 mvneclipse 0m 52s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 1s the patch passed +1 javadoc 1m 26s the patch passed +1 unit 9m 5s hadoop-common in the patch passed. -1 unit 44m 21s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 44s The patch does not generate ASF License warnings. 148m 3s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer   hadoop.yarn.server.resourcemanager.TestRMRestart Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA   org.apache.hadoop.yarn.server.resourcemanager.TestKillApplicationWithRMHA Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HADOOP-14412 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12867664/HADOOP-14412.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux fce2e2c3b875 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 0d5c8ed Default Java 1.8.0_121 findbugs v3.1.0-RC1 findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12297/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jlowe Jason Lowe added a comment -

          Posting a patch that uses AtomicReference to remove the need for any locking. The basic idea is to keep track of an immutable snapshot of the current state. If the state changes then we build a new snapshot and atomically replace the old state. When we need to look at the current state we grab the snapshot reference once then always use that for the duration of the operation that needs to examine the state.

          Show
          jlowe Jason Lowe added a comment - Posting a patch that uses AtomicReference to remove the need for any locking. The basic idea is to keep track of an immutable snapshot of the current state. If the state changes then we build a new snapshot and atomically replace the old state. When we need to look at the current state we grab the snapshot reference once then always use that for the duration of the operation that needs to examine the state.
          Hide
          jlowe Jason Lowe added a comment -

          Looks like this was caused by YARN-4002. A typical stack trace we are seeing looks like this:

              java.util.HashMap.resize(HashMap.java:734)
              java.util.HashMap.putVal(HashMap.java:662)
              java.util.HashMap.put(HashMap.java:611)
              java.util.HashSet.add(HashSet.java:219)
              java.util.AbstractCollection.addAll(AbstractCollection.java:344)
              org.apache.hadoop.util.HostsFileReader.getHostDetails(HostsFileReader.java:211)
              org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.isValidNode(NodesListManager.java:367)
              org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService.nodeHeartbeat(ResourceTrackerService.java:532)
              org.apache.hadoop.yarn.server.api.impl.pb.service.ResourceTrackerPBServiceImpl.nodeHeartbeat(ResourceTrackerPBServiceImpl.java:71)
              org.apache.hadoop.yarn.proto.ResourceTracker$ResourceTrackerService$2.callBlockingMethod(ResourceTracker.java:97)
              org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:448)
              org.apache.hadoop.ipc.RPC$Server.call(RPC.java:999)
              org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:879)
              org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:808)
              java.security.AccessController.doPrivileged(Native Method)
              javax.security.auth.Subject.doAs(Subject.java:422)
              org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1936)
              org.apache.hadoop.ipc.Server$Handler.run(Server.java:2507)
          
          Show
          jlowe Jason Lowe added a comment - Looks like this was caused by YARN-4002 . A typical stack trace we are seeing looks like this: java.util.HashMap.resize(HashMap.java:734) java.util.HashMap.putVal(HashMap.java:662) java.util.HashMap.put(HashMap.java:611) java.util.HashSet.add(HashSet.java:219) java.util.AbstractCollection.addAll(AbstractCollection.java:344) org.apache.hadoop.util.HostsFileReader.getHostDetails(HostsFileReader.java:211) org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.isValidNode(NodesListManager.java:367) org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService.nodeHeartbeat(ResourceTrackerService.java:532) org.apache.hadoop.yarn.server.api.impl.pb.service.ResourceTrackerPBServiceImpl.nodeHeartbeat(ResourceTrackerPBServiceImpl.java:71) org.apache.hadoop.yarn.proto.ResourceTracker$ResourceTrackerService$2.callBlockingMethod(ResourceTracker.java:97) org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:448) org.apache.hadoop.ipc.RPC$Server.call(RPC.java:999) org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:879) org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:808) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1936) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2507)

            People

            • Assignee:
              jlowe Jason Lowe
              Reporter:
              jlowe Jason Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development