Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-12991

Ozone: Service Discovery: Limit the number of datanodes (REST servers) returned by KeySpaceManager#getServiceList call

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • ozone
    • None

    Description

      To limit the number of datanodes (REST servers) returned by KeySpaceManager#getServiceList call we should use ozone.rest.servers property. The value for this property can be configured in the following 3 ways.

      • List of machines
        Expressed as a hostname/IP of the machine followed by one or more machines which are comma separated.
      • IP/netmask notation
        Single value that looks like 192.234.200.0/255.255.255.0, In this only nodes with the matching IP address specified by this netmask will appear.
      • Regular expression which matches hostname
        This acts as a filter on the hostnames - For example datanode[9?].xxx.com - will expose only datanodes that are named datanode90,datanode91..etc(assuming datanodes are numbered using decimal in this example) nodes.

      These node lists are exposed if and only if they are healthy by default.

      All these three different forms are mutually exclusive and we will flag an error if more than one form is specified.

      If the property is missing or if the value is empty, KSM will return all datanodes that are healthy.

      Attachments

        Activity

          People

            Unassigned Unassigned
            nanda Nandakumar
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: