Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5376

Incremental rescanning of cached blocks and cache entries

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Open
    • Major
    • Resolution: Unresolved
    • HDFS-4949
    • None
    • namenode
    • None

    Description

      CacheReplicationMonitor#rescan is invoked whenever a new cache entry is added or removed. This involves a complete rescan of all cache entries and cached blocks, which is potentially expensive. It'd be better to do an incremental scan instead. This would also let us incrementally re-scan on namespace changes like rename and create for better caching latency.

      Attachments

        Activity

          People

            hgadre Hrishikesh Gadre
            andrew.wang Andrew Wang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: