Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7915

The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Target Version/s:

      Description

      The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error. In DataXceiver#requestShortCircuitFds, the DataNode can succeed at the first part (mark the slot as used) and fail at the second part (tell the DFSClient what it did). The "try" block for unregistering the slot only covers a failure in the first part, not the second part. In this way, a divergence can form between the views of which slots are allocated on DFSClient and on server.

        Attachments

        1. HDFS-7915.001.patch
          13 kB
          Colin McCabe
        2. HDFS-7915.002.patch
          13 kB
          Colin McCabe
        3. HDFS-7915.004.patch
          21 kB
          Colin McCabe
        4. HDFS-7915.005.patch
          21 kB
          Colin McCabe
        5. HDFS-7915.006.patch
          21 kB
          Colin McCabe
        6. HDFS-7915.branch-2.6.patch
          21 kB
          Akira Ajisaka

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              cmccabe Colin McCabe Assign to me
              Reporter:
              cmccabe Colin McCabe

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment