Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4949 Centralized cache management in HDFS
  3. HDFS-5394

fix race conditions in DN caching and uncaching

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.3.0
    • datanode, namenode
    • None

    Description

      The DN needs to handle situations where it is asked to cache the same replica more than once. (Currently, it can actually do two mmaps and mlocks.) It also needs to handle the situation where caching a replica is cancelled before said caching completes.

      Attachments

        1. HDFS-5394.005.patch
          44 kB
          Colin McCabe
        2. HDFS-5394.006.patch
          46 kB
          Colin McCabe
        3. HDFS-5394.007.patch
          50 kB
          Colin McCabe
        4. HDFS-5394.008.patch
          50 kB
          Colin McCabe
        5. HDFS-5394.009.patch
          50 kB
          Colin McCabe
        6. HDFS-5394-caching.001.patch
          43 kB
          Colin McCabe
        7. HDFS-5394-caching.002.patch
          43 kB
          Colin McCabe
        8. HDFS-5394-caching.003.patch
          43 kB
          Colin McCabe
        9. HDFS-5394-caching.004.patch
          44 kB
          Colin McCabe

        Issue Links

          blocks

          Sub-task - The sub-task of the issue HDFS-5366 recaching improvements

          • Major - Major loss of function.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-5182 BlockReaderLocal must allow zero-copy reads only when the DN believes it's valid

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cmccabe Colin McCabe
              cmccabe Colin McCabe
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: