Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-3982

Add LRU mechanism to address memory concerns and possibly pre-fetch Tablet Locations.

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.6.3, 1.7.0, 1.8.0
    • Fix Version/s: None
    • Component/s: client, tserver
    • Labels:
      None

      Description

      On larger systems, especially those of which may split frequently, I've seen churn in the TabletLocator caches. Could we possibly pre-fetch entries for a table so that we don't constantly access the metadata table for tablet locations.

      Additionally, instead of clearing the cache in the case of a miss or failure, could we simply update those entries in the cache? If we do this we may minimize cache misses overall and the need to scan the meta data table. If need be, we could have a threshold before clearing the cache entirely if people see the need for that.

      It would also be helpful to add an LRU cache ( or maybe even priority based LRU cache ). In ACCUMULO-3549, we added a cache clear to TabletServer to avoid overwhelming memory. An LRU cache might address this concern and make the clear cache call unnecessary.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ecn Eric C. Newton
                Reporter:
                phrocker Marc Parisi
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: