Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6047

TestPread NPE inside in DFSInputStream hedgedFetchBlockByteRange

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.4.0
    • 2.4.0
    • None
    • None
    • Reviewed

    Description

      Our Andrew Wang saw this on internal test cluster running trunk:

      java.lang.NullPointerException: null
      	at org.apache.hadoop.hdfs.DFSInputStream.hedgedFetchBlockByteRange(DFSInputStream.java:1181)
      	at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:1296)
      	at org.apache.hadoop.fs.FSInputStream.readFully(FSInputStream.java:78)
      	at org.apache.hadoop.fs.FSDataInputStream.readFully(FSDataInputStream.java:108)
      	at org.apache.hadoop.hdfs.TestPread.pReadFile(TestPread.java:151)
      	at org.apache.hadoop.hdfs.TestPread.testMaxOutHedgedReadPool(TestPread.java:292)
      

      TestPread was failing.

      The NPE comes of our presuming there always a chosenNode as we set up hedged reads inside in hedgedFetchBlockByteRange (chosenNode is null'd each time through the loop). Usually there is a chosenNode but need to allow for case where there is not.

      Attachments

        1. HDFS-6047.txt
          1 kB
          Michael Stack
        2. HDFS-6047.txt
          1 kB
          Michael Stack
        3. HDFS-6047.txt
          1 kB
          Michael Stack

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stack Michael Stack
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment