HBase
  1. HBase
  2. HBASE-4797

[availability] Skip recovered.edits files with edits we know older than what region currently has

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.0
    • Component/s: Performance
    • Labels:
    • Hadoop Flags:
      Reviewed
    • Tags:
      noob

      Description

      Testing 0.92, I crashed all servers out. Another bug makes it so WALs are not getting cleaned so I had 7000 regions to replay. The distributed split code did a nice job and cluster came back but interesting is that some hot regions ended up having loads of recovered.edits files – tens if not hundreds – to replay against the region (can we bulk load recovered.edits instead of replaying them?). Each recovered.edits file is taking about a second to process (though only about 30 odd edits per file it seems). The region is unavailable during this time.

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Jimmy Xiang
            Reporter:
            stack
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development