Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6047

TestPread NPE inside in DFSInputStream hedgedFetchBlockByteRange

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.4.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Our Andrew Wang saw this on internal test cluster running trunk:

      java.lang.NullPointerException: null
      	at org.apache.hadoop.hdfs.DFSInputStream.hedgedFetchBlockByteRange(DFSInputStream.java:1181)
      	at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:1296)
      	at org.apache.hadoop.fs.FSInputStream.readFully(FSInputStream.java:78)
      	at org.apache.hadoop.fs.FSDataInputStream.readFully(FSDataInputStream.java:108)
      	at org.apache.hadoop.hdfs.TestPread.pReadFile(TestPread.java:151)
      	at org.apache.hadoop.hdfs.TestPread.testMaxOutHedgedReadPool(TestPread.java:292)
      

      TestPread was failing.

      The NPE comes of our presuming there always a chosenNode as we set up hedged reads inside in hedgedFetchBlockByteRange (chosenNode is null'd each time through the loop). Usually there is a chosenNode but need to allow for case where there is not.

      1. HDFS-6047.txt
        1 kB
        stack
      2. HDFS-6047.txt
        1 kB
        stack
      3. HDFS-6047.txt
        1 kB
        stack

        Activity

          People

          • Assignee:
            stack
            Reporter:
            stack
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development