Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2995

start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: HA branch (HDFS-1623)
    • Fix Version/s: 2.0.0-alpha
    • Component/s: scripts
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Target Version/s:

      Description

      When I run "start-dfs.sh" it tries to start a 2NN on every node in the cluster. This despite:

      [todd@c1120 hadoop-active]$ ./bin/hdfs getconf -secondaryNameNodes
      Incorrect configuration: secondary namenode address dfs.namenode.secondary.http-address is not configured.

      Thankfully they do not start

      1. hdfs-2995.txt
        2 kB
        Eli Collins

        Issue Links

          Activity

          Hide
          Suresh Srinivas added a comment -

          Could this be related to HDFS-2893?

          Show
          Suresh Srinivas added a comment - Could this be related to HDFS-2893 ?
          Hide
          Todd Lipcon added a comment -

          Seems likely. Eli, I see you're watching this ticket - want to take a look?

          Show
          Todd Lipcon added a comment - Seems likely. Eli, I see you're watching this ticket - want to take a look?
          Hide
          Eli Collins added a comment -

          Patch attached. Updates start/stop scripts to only try to start the 2NN on NNs with http-address configured.

          Show
          Eli Collins added a comment - Patch attached. Updates start/stop scripts to only try to start the 2NN on NNs with http-address configured.
          Hide
          Eli Collins added a comment -

          Verified with a tarball that a 2NN is not started/stopped when http-address is not set, and started/stopped when it is.

          Show
          Eli Collins added a comment - Verified with a tarball that a 2NN is not started/stopped when http-address is not set, and started/stopped when it is.
          Hide
          Aaron T. Myers added a comment -

          +1, the patch looks good to me.

          Show
          Aaron T. Myers added a comment - +1, the patch looks good to me.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #1976 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1976/)
          HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins (Revision 1308174)

          Result = FAILURE
          eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308174
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1976 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1976/ ) HDFS-2995 . start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins (Revision 1308174) Result = FAILURE eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308174 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #1003 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1003/)
          HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins (Revision 1308174)

          Result = FAILURE
          eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308174
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1003 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1003/ ) HDFS-2995 . start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins (Revision 1308174) Result = FAILURE eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308174 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #1038 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1038/)
          HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins (Revision 1308174)

          Result = FAILURE
          eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308174
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1038 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1038/ ) HDFS-2995 . start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins (Revision 1308174) Result = FAILURE eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308174 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          Hide
          Todd Lipcon added a comment -

          Looks like this got committed to trunk and branch-2 last week.

          Show
          Todd Lipcon added a comment - Looks like this got committed to trunk and branch-2 last week.

            People

            • Assignee:
              Eli Collins
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development