Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4320

Add a separate configuration for namenode rpc address instead of only using fs.default.name

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.1.0, 2.1.1-beta, 3.0.0-alpha1
    • 1.2.0
    • datanode, namenode
    • None
    • Reviewed
    • Hide
      The namenode RPC address is currently identified from configuration "fs.default.name". In some setups where default FS is other than HDFS, the "fs.default.name" cannot be used to get the namenode address. When such a setup co-exists with HDFS, with this change namenode can be identified using a separate configuration parameter "dfs.namenode.rpc-address".

      "dfs.namenode.rpc-address", when configured, overrides fs.default.name for identifying namenode RPC address.
      Show
      The namenode RPC address is currently identified from configuration "fs.default.name". In some setups where default FS is other than HDFS, the "fs.default.name" cannot be used to get the namenode address. When such a setup co-exists with HDFS, with this change namenode can be identified using a separate configuration parameter "dfs.namenode.rpc-address". "dfs.namenode.rpc-address", when configured, overrides fs.default.name for identifying namenode RPC address.

    Description

      When NameNode starts up, it tries to find out its address by looking at the fs.default.name configuration key instead of using its own keys. This breaks scenarios where we try to configure a Hadoop cluster that uses a different default file system than DFS, but still try to prop up namenode and datanode services as a secondary file system.

      Attachments

        1. HDFS-4320.branch-1.2.patch
          2 kB
          Mostafa Elhemali
        2. HDFS-4320.branch-1.3.patch
          3 kB
          Mostafa Elhemali
        3. HDFS-4320.patch
          0.9 kB
          Mostafa Elhemali
        4. HDFS-4320.trunk.2.patch
          2 kB
          Mostafa Elhemali
        5. HDFS-4320.trunk.patch
          1 kB
          Mostafa Elhemali
        6. HDFS-4320-trunk.3.patch
          0.7 kB
          Chuan Liu
        7. HDFS-4320-trunk.4.patch
          1 kB
          Chuan Liu

        Activity

          People

            mostafae Mostafa Elhemali
            mostafae Mostafa Elhemali
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: