Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4949 Centralized cache management in HDFS
  3. HDFS-5634

allow BlockReaderLocal to switch between checksumming and not

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • hdfs-client
    • None

    Description

      BlockReaderLocal should be able to switch between checksumming and non-checksumming, so that when we get notifications that something is mlocked (see HDFS-5182), we can avoid checksumming when reading from that block.

      Attachments

        1. HDFS-5634.001.patch
          63 kB
          Colin McCabe
        2. HDFS-5634.002.patch
          64 kB
          Colin McCabe
        3. HDFS-5634.003.patch
          66 kB
          Colin McCabe
        4. HDFS-5634.004.patch
          66 kB
          Colin McCabe
        5. HDFS-5634.005.patch
          79 kB
          Colin McCabe
        6. HDFS-5634.006.patch
          80 kB
          Colin McCabe
        7. HDFS-5634.007.patch
          72 kB
          Colin McCabe
        8. HDFS-5634.008.patch
          72 kB
          Colin McCabe
        9. HDFS-5634.009.branch-2.patch
          71 kB
          Colin McCabe

        Issue Links

        blocks

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-5182 BlockReaderLocal must allow zero-copy reads only when the DN believes it's valid

        • Major - Major loss of function.
        • Closed
        is duplicated by

        Bug - A problem which impairs or prevents the functions of the product. HDFS-4710 SCR should honor dfs.client.read.shortcircuit.buffer.size even when checksums are off

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDFS-4697 short-circuit reads do not honor readahead settings

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed
        is related to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-5656 add some configuration keys to hdfs-default.xml

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-4710 SCR should honor dfs.client.read.shortcircuit.buffer.size even when checksums are off

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDFS-4960 Unnecessary .meta seeks even when skip checksum is true

        • Major - Major loss of function.
        • Patch Available
        supercedes

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-5574 Remove buffer copy in BlockReader.skip

        • Trivial - Cosmetic problem like misspelt words or misaligned text.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cmccabe Colin McCabe
            cmccabe Colin McCabe
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment