Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13539

DFSStripedInputStream NPE when reportCheckSumFailure

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.2.0, 3.1.1, 3.0.3
    • None
    • None
    • Reviewed

    Description

      We have seem the following exception with DFSStripedInputStream.

      readDirect: FSDataInputStream#read error:
      NullPointerException: java.lang.NullPointerException
              at org.apache.hadoop.hdfs.DFSStripedInputStream.readWithStrategy(DFSStripedInputStream.java:402)
              at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:831)
              at org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:147)
      

      Line 402 is reportCheckSumFailure, and currentLocatedBlock is the only possible null object. (Because currentLocatedBlock.getLocations() cannot be null - LocatedBlock constructor checks locs and would assign a EMPTY_LOCS if it's null)

      Original exception is masked by the NPE.

      Attachments

        1. HDFS-13539.02.patch
          5 kB
          Xiao Chen
        2. HDFS-13539.01.patch
          6 kB
          Xiao Chen

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            xiaochen Xiao Chen
            xiaochen Xiao Chen
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment