Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22492

Amortize lock contention due to LRFU accounting

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • None
    • None

    Description

      LRFU eviction policy can be a major source of contention under high load.
      This can be see on the following profiles.
      To fix this the idea is to use a batching wrapper to amortize the locking contention.
      The trick i a common way to amortize locking as explained here http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf

      Attachments

        1. HIVE-22492.2.patch
          15 kB
          Slim Bouguerra
        2. HIVE-22492.patch
          17 kB
          Slim Bouguerra
        3. llap-lock-contention.svg
          228 kB
          Slim Bouguerra

        Activity

          People

            bslim Slim Bouguerra
            bslim Slim Bouguerra
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: