Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-3499

Users upgrading to 0.90.0 need to have their .META. table updated with the right MEMSTORE_SIZE

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.90.0
    • Fix Version/s: 0.90.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      With Jack Levin, we were able to figure that users that are upgrading from a 0.20.x era cluster have their .META. schema set with a 16KB MEMSTORE_SIZE. This was done in order to minimize lost meta rows when append wasn't available but even if we changed it in HTD, we also have to make sure all users upgrading to 0.90 have it changed too.

      In Jack's case, he ended up with 2143 storefiles in .META. during a cold start, slowing everything down. He reported a few times in the past that his .META. was always extremely busy.

      We should be able to do it as a one-off thing in HMaster when opening .META. (an update in place).

        Attachments

        1. Chapter 2. Upgrading.html
          6 kB
          stack
        2. set_meta_memstore_size.rb
          3 kB
          Jean-Daniel Cryans

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jdcryans Jean-Daniel Cryans
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: