Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2468

Improvements to prewarm META cache on clients

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.90.0
    • Client
    • Reviewed

    Description

      A couple different use cases cause storms of reads to META during startup. For example, a large MR job will cause each map task to hit meta since it starts with an empty cache.

      A couple possible improvements have been proposed:

      • MR jobs could ship a copy of META for the table in the DistributedCache
      • Clients could prewarm cache by doing a large scan of all the meta for the table instead of random reads for each miss
      • Each miss could fetch ahead some number of rows in META

      Attachments

        1. HBASE-2468-trunk.patch
          11 kB
          Mingjie Lai

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mingjielai Mingjie Lai
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment