Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4949 Centralized cache management in HDFS
  3. HDFS-5634

allow BlockReaderLocal to switch between checksumming and not

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • hdfs-client
    • None

    Description

      BlockReaderLocal should be able to switch between checksumming and non-checksumming, so that when we get notifications that something is mlocked (see HDFS-5182), we can avoid checksumming when reading from that block.

      Attachments

        1. HDFS-5634.001.patch
          63 kB
          Colin McCabe
        2. HDFS-5634.002.patch
          64 kB
          Colin McCabe
        3. HDFS-5634.003.patch
          66 kB
          Colin McCabe
        4. HDFS-5634.004.patch
          66 kB
          Colin McCabe
        5. HDFS-5634.005.patch
          79 kB
          Colin McCabe
        6. HDFS-5634.006.patch
          80 kB
          Colin McCabe
        7. HDFS-5634.007.patch
          72 kB
          Colin McCabe
        8. HDFS-5634.008.patch
          72 kB
          Colin McCabe
        9. HDFS-5634.009.branch-2.patch
          71 kB
          Colin McCabe

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-5182 BlockReaderLocal must allow zero-copy reads only when the DN believes it's valid

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4710 SCR should honor dfs.client.read.shortcircuit.buffer.size even when checksums are off

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4697 short-circuit reads do not honor readahead settings

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5656 add some configuration keys to hdfs-default.xml

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4710 SCR should honor dfs.client.read.shortcircuit.buffer.size even when checksums are off

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4960 Unnecessary .meta seeks even when skip checksum is true

          • Major - Major loss of function.
          • Patch Available
          supercedes

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-5574 Remove buffer copy in BlockReader.skip

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved

          Activity

            People

              cmccabe Colin McCabe
              cmccabe Colin McCabe
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: