HBase
  1. HBase
  2. HBASE-69

[hbase] Make cache flush triggering less simplistic

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: 0.2.0
    • Component/s: regionserver
    • Labels:
      None

      Description

      When flusher runs – its triggered when the sum of all Stores in a Region > a configurable max size – we flush all Stores though a Store memcache might have but a few bytes.

      I would think Stores should only dump their memcache disk if they have some substance.

      The problem becomes more acute, the more families you have in a Region.

      Possible behaviors would be to dump the biggest Store only, or only those Stores > 50% of max memcache size. Behavior would vary dependent on the prompt that provoked the flush. Would also log why the flush is running: optional or > max size.

      This issue comes out of HADOOP-2621.

      1. patch.txt
        183 kB
        Jim Kellerman
      2. patch.txt
        183 kB
        Jim Kellerman
      3. patch.txt
        168 kB
        Jim Kellerman
      4. patch.txt
        146 kB
        Jim Kellerman
      5. patch.txt
        144 kB
        Jim Kellerman
      6. patch.txt
        181 kB
        Jim Kellerman
      7. patch.txt
        180 kB
        Jim Kellerman
      8. patch.txt
        180 kB
        Jim Kellerman
      9. patch.txt
        179 kB
        Jim Kellerman
      10. patch.txt
        176 kB
        Jim Kellerman
      11. patch.txt
        171 kB
        Jim Kellerman
      12. patch.txt
        168 kB
        Jim Kellerman
      13. patch.txt
        169 kB
        Jim Kellerman
      14. patch.txt
        145 kB
        Jim Kellerman

        Issue Links

          Activity

            People

            • Assignee:
              Jim Kellerman
              Reporter:
              stack
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development