Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5333

Introduce Memstore "backpressure" for writes

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      Currently if the memstore/flush/compaction cannot keep up with the writeload, we block writers up to hbase.hstore.blockingWaitTime milliseconds (default is 90000).
      Would be nice if there was a concept of a soft "backpressure" that slows writing clients gracefully before we reach this condition.

      From the log:
      "2012-02-04 00:00:06,963 WARN org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Region <table>,,1328313512779.c2761757621ddf8fb78baf5288d71271. has too many store files; delaying flush up to 90000ms"

      Attachments

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. HBASE-5162 Basic client pushback mechanism

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-6423 Writes should not block reads on blocking updates to memstores

          • Major - Major loss of function.
          • Closed
          relates to

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' HBASE-2981 Improve consistency of performance during heavy load

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              larsh Lars Hofhansl
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: