Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-69

[hbase] Make cache flush triggering less simplistic

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: 0.2.0
    • Component/s: regionserver
    • Labels:
      None

      Description

      When flusher runs – its triggered when the sum of all Stores in a Region > a configurable max size – we flush all Stores though a Store memcache might have but a few bytes.

      I would think Stores should only dump their memcache disk if they have some substance.

      The problem becomes more acute, the more families you have in a Region.

      Possible behaviors would be to dump the biggest Store only, or only those Stores > 50% of max memcache size. Behavior would vary dependent on the prompt that provoked the flush. Would also log why the flush is running: optional or > max size.

      This issue comes out of HADOOP-2621.

        Attachments

        1. patch.txt
          145 kB
          Jim Kellerman
        2. patch.txt
          169 kB
          Jim Kellerman
        3. patch.txt
          168 kB
          Jim Kellerman
        4. patch.txt
          171 kB
          Jim Kellerman
        5. patch.txt
          176 kB
          Jim Kellerman
        6. patch.txt
          179 kB
          Jim Kellerman
        7. patch.txt
          180 kB
          Jim Kellerman
        8. patch.txt
          180 kB
          Jim Kellerman
        9. patch.txt
          181 kB
          Jim Kellerman
        10. patch.txt
          144 kB
          Jim Kellerman
        11. patch.txt
          146 kB
          Jim Kellerman
        12. patch.txt
          168 kB
          Jim Kellerman
        13. patch.txt
          183 kB
          Jim Kellerman
        14. patch.txt
          183 kB
          Jim Kellerman

          Issue Links

            Activity

              People

              • Assignee:
                jimk Jim Kellerman
                Reporter:
                stack stack
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: