Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12638

Delete copy-on-truncate block along with the original block, when deleting a file being truncated

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 2.8.2
    • 2.8.3, 2.7.5, 3.1.0, 2.10.0, 2.9.1, 3.0.1
    • hdfs
    • None

    Description

      Active NamNode exit due to NPE, I can confirm that the BlockCollection passed in when creating ReplicationWork is null, but I do not know why BlockCollection is null, By view history I found HDFS-9754 remove judging whether BlockCollection is null.

      NN logs are as following:

      2017-10-11 16:29:06,161 ERROR [ReplicationMonitor] org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: ReplicationMonitor thread received Runtime exception.
      java.lang.NullPointerException
              at org.apache.hadoop.hdfs.server.blockmanagement.ReplicationWork.chooseTargets(ReplicationWork.java:55)
              at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeReplicationWorkForBlocks(BlockManager.java:1532)
              at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeReplicationWork(BlockManager.java:1491)
              at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeDatanodeWork(BlockManager.java:3792)
              at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor.run(BlockManager.java:3744)
              at java.lang.Thread.run(Thread.java:834)
      

      Attachments

        1. HDFS-12638.002.patch
          2 kB
          Konstantin Shvachko
        2. HDFS-12638.003.patch
          5 kB
          Konstantin Shvachko
        3. HDFS-12638.004.patch
          5 kB
          Konstantin Shvachko
        4. HDFS-12638-branch-2.8.2.001.patch
          2 kB
          Jiandan Yang
        5. OphanBlocksAfterTruncateDelete.jpg
          89 kB
          Weiwei Yang

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            shv Konstantin Shvachko
            yangjiandan Jiandan Yang
            Votes:
            0 Vote for this issue
            Watchers:
            23 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment