Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20643 Getting HDFSBlockDist in Master by querying RegionServers
  3. HBASE-22356

API to get hdfs block distribution from regionservers

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Abandoned
    • None
    • None
    • API, Balancer, regionserver

    Description

      A RegionServer API has to be added which will return HDFSBlockDistribution for all the regions it hosts. RS already has this info cached and updated when flush/compaction happens. Master can query and get instead of hitting the namenode and caching. The larger the cluster becomes, the more costly it becomes to get this information and more stale the cached information becomes.

      This jira is only to add the API to regionserver.

      Attachments

        1. HBASE-22356.master.001.patch
          22 kB
          Thiruvel Thirumoolan
        2. HBASE-22356.master.002.patch
          22 kB
          Thiruvel Thirumoolan
        3. HBASE-22356.master.003.patch
          22 kB
          Thiruvel Thirumoolan

        Activity

          People

            Unassigned Unassigned
            thiruvel Thiruvel Thirumoolan
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: