Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8173

NPE thrown at DataNode shutdown when HTTP server was not able to create

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      NPE thrown at Datanode startup –

      2015-04-17 17:37:01,069 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exception shutting down DataNode HttpServer
      java.lang.NullPointerException
              at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.java:1703)
              at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:433)
              at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2392)
              at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2279)
              at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2326)
              at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2503)
              at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2527)
      
      1. HDFS-8173.patch
        1 kB
        Surendra Singh Lilhore

        Activity

        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Attached patch , Please review

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Attached patch , Please review
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12726132/HDFS-8173.patch
        against trunk revision 76e7264.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10297//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10297//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12726132/HDFS-8173.patch against trunk revision 76e7264. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/10297//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/10297//console This message is automatically generated.
        Hide
        stevel@apache.org Steve Loughran added a comment -

        duplicate of the HDFS-8148; no need to file a new JIRA when supplying a patch for an existing problem.

        ...and that's been fixed by HDFS-6666

        Show
        stevel@apache.org Steve Loughran added a comment - duplicate of the HDFS-8148 ; no need to file a new JIRA when supplying a patch for an existing problem. ...and that's been fixed by HDFS-6666
        Hide
        stevel@apache.org Steve Loughran added a comment -

        actually, it's different, isn't it? my mistake

        Show
        stevel@apache.org Steve Loughran added a comment - actually, it's different, isn't it? my mistake
        Hide
        brahmareddy Brahma Reddy Battula added a comment -

        IIUC Yes, It is different..Surendra Singh Lilhore thanks for takeup this jira.. Patch ,LGTM, +1 ( non-binding)..

        Show
        brahmareddy Brahma Reddy Battula added a comment - IIUC Yes, It is different.. Surendra Singh Lilhore thanks for takeup this jira.. Patch ,LGTM, +1 ( non-binding)..
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Thanks Brahma Reddy Battula and Steve Loughran for looking into this issue.
        Yes, it is different. This we got when DN http server port is used by some other process.

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Thanks Brahma Reddy Battula and Steve Loughran for looking into this issue. Yes, it is different. This we got when DN http server port is used by some other process.
        Hide
        vinayrpet Vinayakumar B added a comment -

        +1,
        will commit soon.

        Show
        vinayrpet Vinayakumar B added a comment - +1, will commit soon.
        Hide
        vinayrpet Vinayakumar B added a comment -

        Committed to trunk and branch-2.
        Thanks Surendra Singh Lilhore for the patch, Brahma Reddy Battula and Steve Loughran for reviews.

        Show
        vinayrpet Vinayakumar B added a comment - Committed to trunk and branch-2. Thanks Surendra Singh Lilhore for the patch, Brahma Reddy Battula and Steve Loughran for reviews.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #7616 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7616/)
        HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7616 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7616/ ) HDFS-8173 . NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Thanks Vinayakumar B for reviewing and for changing the title, now it is more clear

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Thanks Vinayakumar B for reviewing and for changing the title, now it is more clear
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #169 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/169/)
        HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #169 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/169/ ) HDFS-8173 . NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2101 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2101/)
        HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2101 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2101/ ) HDFS-8173 . NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #160 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/160/)
        HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #160 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/160/ ) HDFS-8173 . NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #903 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/903/)
        HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #903 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/903/ ) HDFS-8173 . NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #170 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/170/)
        HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #170 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/170/ ) HDFS-8173 . NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2119 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2119/)
        HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2119 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2119/ ) HDFS-8173 . NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) (vinayakumarb: rev c17cd4f7c163cf97d6e42865df25709f29d39e3d) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

          People

          • Assignee:
            surendrasingh Surendra Singh Lilhore
            Reporter:
            archanat Archana T
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development