Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6581 Write to single replica in memory
  3. HDFS-6930

Improve replica eviction from RAM disk

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • HDFS-6581
    • 2.6.0
    • datanode
    • None
    • Reviewed

    Description

      The current replica eviction scheme is inefficient since it performs multiple file operations in the context of block allocation.

      A better implementation would be asynchronous eviction when free space on RAM disk falls below a low watermark to make block allocation faster.

      Attachments

        1. HDFS-6930.01.patch
          16 kB
          Arpit Agarwal
        2. HDFS-6930.02.patch
          17 kB
          Arpit Agarwal

        Issue Links

          is duplicated by

          Sub-task - The sub-task of the issue HDFS-6991 Notify NN of evicted block before deleting it from RAM disk

          • Major - Major loss of function.
          • Closed
          is required by

          Sub-task - The sub-task of the issue HDFS-6977 Delete all copies when a block is deleted from the block space

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue HDFS-6991 Notify NN of evicted block before deleting it from RAM disk

          • Major - Major loss of function.
          • Closed

          Activity

            People

              arp Arpit Agarwal
              arp Arpit Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: