Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3215

Block size is logging as zero Even blockrecevied command received by DN

    Details

    • Type: Bug Bug
    • Status: Patch Available
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.0.0-alpha, 3.0.0
    • Fix Version/s: None
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:

      Description

      Scenario 1
      ==========

      Start NN and DN.
      write file.
      Block size is logging as zero Even blockrecevied command received by DN

      NN log

      2012-03-14 20:23:40,541 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.allocateBlock: /hadoop-create-user.sh.COPYING. BP-1166515020-10.18.40.24-1331736264353 blk_1264419582929433995_1002

      {blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[XXXXXXX:50010|RBW]]}

      2012-03-14 20:24:26,357 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* addStoredBlock: blockMap updated: XXXXXXX:50010 is added to blk_1264419582929433995_1002

      {blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[XXXXXXX:50010|RBW]]}

      size 0

      DN log

      2012-03-14 20:24:17,519 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving block BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002 src: /XXXXXXX:53141 dest: /XXXXXXX:50010

      2012-03-14 20:24:26,517 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /XXXXXXX:53141, dest: /XXXXXXX:50010, bytes: 512, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1612873957_1, offset: 0, srvID: DS-1639667928-XXXXXXX-50010-1331736284942, blockid: BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002, duration: 1286482503

      2012-03-14 20:24:26,517 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
      2012-03-14 20:24:31,533 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002

      1. HDFS-3215.patch
        0.8 kB
        Shinichi Yamashita
      2. HDFS-3215.patch
        4 kB
        Shinichi Yamashita

        Activity

        Shinichi Yamashita made changes -
        Attachment HDFS-3215.patch [ 12614783 ]
        Shinichi Yamashita made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 3.0.0 [ 12320356 ]
        Shinichi Yamashita made changes -
        Attachment HDFS-3215.patch [ 12614576 ]
        Shinichi Yamashita made changes -
        Affects Version/s 3.0.0 [ 12320356 ]
        Shinichi Yamashita made changes -
        Assignee Shinichi Yamashita [ sinchii ]
        Arun C Murthy made changes -
        Fix Version/s 2.0.0-alpha [ 12320353 ]
        Fix Version/s 3.0.0 [ 12320356 ]
        Brahma Reddy Battula made changes -
        Field Original Value New Value
        Description Scenario
        ==========

        Start NN and DN.
        write file.
        Block size is logging as zero Even blockrecevied command received by DN

         *NN log*

        2012-03-14 20:23:40,541 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.allocateBlock: /hadoop-create-user.sh._COPYING_. BP-1166515020-10.18.40.24-1331736264353 blk_1264419582929433995_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[XXXXXXX:50010|RBW]]}

        2012-03-14 20:24:26,357 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* addStoredBlock: blockMap updated: XXXXXXX:50010 is added to blk_1264419582929433995_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[XXXXXXX:50010|RBW]]} size 0

         *DN log*

        2012-03-14 20:24:17,519 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving block BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002 src: /XXXXXXX:53141 dest: /XXXXXXX:50010

        2012-03-14 20:24:26,517 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /XXXXXXX:53141, dest: /XXXXXXX:50010, bytes: 512, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1612873957_1, offset: 0, srvID: DS-1639667928-XXXXXXX-50010-1331736284942, blockid: BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002, duration: 1286482503

        2012-03-14 20:24:26,517 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
        2012-03-14 20:24:31,533 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002
        [ Show » ] Brahma Reddy Battula added a comment - 16-Mar-12 10:13 AM Scenario 2: ========== Start NN and DN. write file. Block size is logging as zero Even blockrecevied command received by DN NN log 2012-03-14 20:23:40,541 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.allocateBlock: /hadoop-create-user.sh._COPYING_. BP-1166515020-XXXXXXX-1331736264353 blk_1264419582929433995_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[XXXXXXX:50010|RBW]]}

        2012-03-14 20:24:26,357 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* addStoredBlock: blockMap updated: XXXXXXX:50010 is added to blk_1264419582929433995_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[XXXXXXX:50010|RBW]]} size 0
        DN log 2012-03-14 20:24:17,519 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving block BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002 src: /XXXXXXX:53141 dest: /XXXXXXX:50010

        2012-03-14 20:24:26,517 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /XXXXXXX:53141, dest: /XXXXXXX:50010, bytes: 512, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1612873957_1, offset: 0, srvID: DS-1639667928-XXXXXXX-50010-1331736284942, blockid: BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002, duration: 1286482503

        2012-03-14 20:24:26,517 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
        2012-03-14 20:24:31,533 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002


        Scenario 1
        ==========

        Start NN and DN.
        write file.
        Block size is logging as zero Even blockrecevied command received by DN

         *NN log*

        2012-03-14 20:23:40,541 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.allocateBlock: /hadoop-create-user.sh._COPYING_. BP-1166515020-10.18.40.24-1331736264353 blk_1264419582929433995_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[XXXXXXX:50010|RBW]]}

        2012-03-14 20:24:26,357 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* addStoredBlock: blockMap updated: XXXXXXX:50010 is added to blk_1264419582929433995_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[XXXXXXX:50010|RBW]]} size 0

         *DN log*

        2012-03-14 20:24:17,519 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving block BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002 src: /XXXXXXX:53141 dest: /XXXXXXX:50010

        2012-03-14 20:24:26,517 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /XXXXXXX:53141, dest: /XXXXXXX:50010, bytes: 512, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1612873957_1, offset: 0, srvID: DS-1639667928-XXXXXXX-50010-1331736284942, blockid: BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002, duration: 1286482503

        2012-03-14 20:24:26,517 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
        2012-03-14 20:24:31,533 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-1166515020-XXXXXXX-1331736264353:blk_1264419582929433995_1002
        Brahma Reddy Battula created issue -

          People

          • Assignee:
            Shinichi Yamashita
            Reporter:
            Brahma Reddy Battula
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:

              Development