Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3033

Datanode fails write to DFS file with exception message "Trying to change block file offset"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.16.1
    • 0.16.2
    • None
    • None

    Description

      A write to a DFS block failed with the lastdatanode in the pipeline reporting this error:

      Receiving block blk_-7279084187433655573 src: /xx.xx.xx.xx:xx dest: /xx.xx.xx.xx:50010
      Changing block file offset of block blk_-7279084187433655573 from 9043968 to 9043968 meta file offset to 70663
      Changing block file offset of block blk_-7279084187433655573 from 111935488 to 112001024 meta file offset to 875015
      Exception in receiveBlock for block blk_-7279084187433655573 java.io.IOException: Trying to change block file offset of block blk_-7279084187433655573 to 112001024 but actual size of file is 111935488
      PacketResponder 0 for block blk_-7279084187433655573 Interrupted.
      PacketResponder 0 for block blk_-7279084187433655573 terminating
      writeBlock blk_-7279084187433655573 received exception java.io.IOException: Trying to change block file offset of block blk_-7279084187433655573 to 112001024 but actual size of file is 111935488
      DataXceiver: java.io.IOException: Trying to change block file offset of block blk_-7279084187433655573 to 112001024 but actual size of file is 111935488

      Attachments

        1. badnode.patch
          2 kB
          Dhruba Borthakur
        2. badnode2.patch
          5 kB
          Dhruba Borthakur

        Issue Links

          Activity

            People

              dhruba Dhruba Borthakur
              dhruba Dhruba Borthakur
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: