Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15531

Favored Nodes Enhancements

    XMLWordPrintableJSON

    Details

    • Type: Umbrella
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We been working on enhancing favored nodes at Yahoo! See draft document. Feel free to comment. I'll add more info.

      https://docs.google.com/document/d/1948RKX_-kGUNOHjiYFiKPZnmKWybJkahJYsNibVhcCk/edit?usp=sharing

      These enhancements have recently started running in production.

        Attachments

          Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-21014 Improve Stochastic Balancer to write HDFS favoured node hints for region primary blocks to avoid destroying data locality if needing to use HDFS Balancer

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-17760 HDFS Balancer doc is misleading

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HBASE-13021 Pin regions blocks to avoid HDFS balancing

          • Major - Major loss of function.
          • Resolved
          supercedes

          New Feature - A new feature of the product, which has yet to be developed. HBASE-4755 HBase based block placement in DFS

          • Critical - Crashes, loss of data, severe memory leak.
          • Open
          links to

          Web Link Favored Nodes v2 - design document

          1.
          		 Support first assignment of split daughters to non-parent RS Sub-task Open Francis Liu
          2.
          		 Add RSGroup Favored Balancer Sub-task In Progress Thiruvel Thirumoolan
          3.
          		 FN Interfaces for writing tools for monitoring/operations Sub-task Patch Available Thiruvel Thirumoolan
          4.
          		 Implement Chore to sync FN info from Master to RegionServers Sub-task Open Thiruvel Thirumoolan
          5.
          		 Add FavoredNode checks to hbck -checkFavoredNodes Sub-task Open Thiruvel Thirumoolan
          6.
          		 Split/Merge - Update of FN info along with regionState change Sub-task Open Thiruvel Thirumoolan
          7.
          		 Refactor StartcodeAgnosticServerName so it doesn't extend ServerName Sub-task Open Thiruvel Thirumoolan
          8.
          		 Add integration tests for FavoredNodes feature Sub-task Open Thiruvel Thirumoolan
          9.
          		 Adding FN documentation to reference guide Sub-task Open Thiruvel Thirumoolan
          10.
          		 Move table to another group (add -migrateTertiary) Sub-task Open Thiruvel Thirumoolan
          11.
          		 Refactor HRegionServer to use regionNames as keys for FN Sub-task Patch Available Thiruvel Thirumoolan
          12.
          		 Admin API to update favored nodes in Master Sub-task Open Thiruvel Thirumoolan
          13.
          		 Tools/API to read favored nodes for region(s) Sub-task Open Thiruvel Thirumoolan
          14.
          		 Tools/Admin API to dump the replica load of server(s) Sub-task Open Thiruvel Thirumoolan
          15.
          		 Follow up enhancements for Favored nodes pickers Sub-task Open Thiruvel Thirumoolan
          16.
          		 Admin API to removeFavoredNode on node decommission Sub-task Open Thiruvel Thirumoolan
          17.
          		 Admin API to check for favored nodes Sub-task Open Thiruvel Thirumoolan
          18.
          		 Admin API to redistribute Favored Nodes Sub-task Open Thiruvel Thirumoolan
          19.
          		 Admin API to do complete redistribute of favored nodes Sub-task Open Thiruvel Thirumoolan

            Activity

              People

              • Assignee:
                toffer Francis Liu
                Reporter:
                toffer Francis Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                28 Start watching this issue

                Dates

                • Created:
                  Updated: