Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-3499

Users upgrading to 0.90.0 need to have their .META. table updated with the right MEMSTORE_SIZE

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.90.0
    • 0.90.1
    • None
    • None
    • Reviewed

    Description

      With Jack Levin, we were able to figure that users that are upgrading from a 0.20.x era cluster have their .META. schema set with a 16KB MEMSTORE_SIZE. This was done in order to minimize lost meta rows when append wasn't available but even if we changed it in HTD, we also have to make sure all users upgrading to 0.90 have it changed too.

      In Jack's case, he ended up with 2143 storefiles in .META. during a cold start, slowing everything down. He reported a few times in the past that his .META. was always extremely busy.

      We should be able to do it as a one-off thing in HMaster when opening .META. (an update in place).

      Attachments

        1. Chapter 2. Upgrading.html
          6 kB
          Michael Stack
        2. set_meta_memstore_size.rb
          3 kB
          Jean-Daniel Cryans

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            jdcryans Jean-Daniel Cryans
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment