Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1034

Enhance datanode to read data and checksum file in parallel

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In the current HDFS implementation, a read of a block issued to the datanode results in a disk access to the checksum file followed by a disk access to the checksum file. It would be nice to be able to do these two IOs in parallel to reduce read latency.

        Attachments

        Issue Links

        is related to

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-918 Use single Selector and small thread pool to replace many instances of BlockSender for reads

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-1599 Umbrella Jira for Improving HBASE support in HDFS

        • Major - Major loss of function.
        • Open

          Activity
          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              dhruba Dhruba Borthakur
              Reporter:
              dhruba Dhruba Borthakur

              Dates

              • Created:
                Updated:

                Issue deployment