Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15801

Backport HDFS-14582 to branch-2.10 (Failed to start DN with ArithmeticException when NULL checksum used)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.10.2
    • Component/s: None

      Description

      In HDFS-14582, the error message is more clear as follows:

      Caused by: java.lang.ArithmeticException: / by zero
              at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.BlockPoolSlice.validateIntegrityAndSetLength(BlockPoolSlice.java:823)
              at 
      

      But in branch-2.10.1, the exception message is omitted as follows:

      2021-01-29 14:20:30,694 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(204)) - Caught exception while adding replicas from /mnt/disk/0/hdfs/data/current. Will throw later.
      java.io.IOException: Failed to start sub tasks to add replica in replica map :java.lang.ArithmeticExceptionjava.io.IOException: Failed to start sub tasks to add replica in replica map :java.lang.ArithmeticException at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.BlockPoolSlice.getVolumeMap(BlockPoolSlice.java:434) at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.getVolumeMap(FsVolumeImpl.java:930) at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeList$1.run(FsVolumeList.java:196)
      

      The specific error message is omitted, causing it harder to find the root cause.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Symious Janus Chow
                Reporter:
                Symious Janus Chow
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h