Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1052 HDFS scalability with multiple namenodes
  3. HDFS-1721

Hdfs Federation: Configuration for principal names should not be namenode specific.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Federation Branch
    • Federation Branch
    • namenode
    • None
    • Reviewed

    Description

      The principal names in the configuration for namenode, secondary namenode, backup namenode, need not be namenode specific, i.e. they need not be configured with keys suffixed with nameserviceId.

      This is because if principals were namenode specific, we would need a mechanism to figure out nameserviceId (to get the namenode specific principal) from fqdn of the files at the client.

      A simpler approach is to use _HOST pattern in the principal names. Hadoop RPC supports replacing the _HOST in the principal with the hostname of the service. Using this approach we need only one principal configuration for all namenodes and similarly one for all secondary namenodes or backup namenodes.

      Attachments

        1. HDFS-1721.2.patch
          2 kB
          Jitendra Nath Pandey
        2. HDFS-1721.1.patch
          2 kB
          Jitendra Nath Pandey

        Activity

          People

            jnp Jitendra Nath Pandey
            jnp Jitendra Nath Pandey
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: