Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5677

Need error checking for HA cluster configuration

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.6-alpha
    • Fix Version/s: 2.3.0
    • Component/s: datanode, ha
    • Labels:
      None
    • Environment:

      centos6.5, oracle jdk6 45,

      Description

      If a node is declared in the dfs.ha.namenodes.myCluster but is not later defined in subsequent dfs.namenode.servicerpc-address.myCluster.nodename or dfs.namenode.rpc-address.myCluster.XXX properties no error or warning message is provided to indicate that.

      The only indication of a problem is a log message like the following:

      WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: myCluster:8020
      

      Another way to look at this is that no error or warning is provided when a servicerpc-address/rpc-address property is defined for a node without a corresponding node declared in dfs.ha.namenodes.myCluster.

      This arose when I had a typo in the dfs.ha.namenodes.myCluster property for one of my node names. It would be very helpful to have at least a warning message on startup if there is a configuration problem like this.

        Attachments

        1. HDFS-5677.patch
          0.9 kB
          Vincent Sheffer

          Activity

            People

            • Assignee:
              vsheffer Vincent Sheffer
              Reporter:
              vsheffer Vincent Sheffer
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: