Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2468

Improvements to prewarm META cache on clients

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.90.0
    • Component/s: Client
    • Hadoop Flags:
      Reviewed

      Description

      A couple different use cases cause storms of reads to META during startup. For example, a large MR job will cause each map task to hit meta since it starts with an empty cache.

      A couple possible improvements have been proposed:

      • MR jobs could ship a copy of META for the table in the DistributedCache
      • Clients could prewarm cache by doing a large scan of all the meta for the table instead of random reads for each miss
      • Each miss could fetch ahead some number of rows in META

        Attachments

          Activity

            People

            • Assignee:
              mingjielai Mingjie Lai
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: