Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3194

DataNode block scanner is running too frequently

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.2-alpha
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Block scanning interval by default should be taken as 21 days(3 weeks) and each block scanning should happen once in 21 days.
      Here the block is being scanned continuosly.

      2012-04-03 10:44:47,056 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
      2012-04-03 10:45:02,064 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
      2012-04-03 10:45:17,071 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
      2012-04-03 10:45:32,079 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473

      1. HDFS-3194_1.patch
        9 kB
        amith
      2. HDFS-3194_2.patch
        14 kB
        amith
      3. HDFS-3194_4.patch
        14 kB
        amith
      4. HDFS-3194_6.patch
        14 kB
        amith
      5. HDFS-3194_7.patch
        15 kB
        amith
      6. HDFS-3194.patch
        8 kB
        amith
      7. hdfs-3194-1.txt
        1 kB
        Andy Isaacson

        Issue Links

          Activity

          suja s created issue -
          suja s made changes -
          Field Original Value New Value
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 1.0.3 [ 12320249 ]
          Affects Version/s 3.0.0 [ 12320356 ]
          Affects Version/s 1.0.3 [ 12320249 ]
          amith made changes -
          Attachment HDFS-3194.patch [ 12522585 ]
          amith made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          amith made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          amith made changes -
          Attachment HDFS-3194_1.patch [ 12523214 ]
          amith made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Target Version/s 3.0.0 [ 12320356 ]
          Uma Maheswara Rao G made changes -
          Assignee Uma Maheswara Rao G [ umamaheswararao ]
          Uma Maheswara Rao G made changes -
          Assignee Uma Maheswara Rao G [ umamaheswararao ] amith [ amithdk ]
          Eli Collins made changes -
          Link This issue is duplicated by HDFS-3410 [ HDFS-3410 ]
          Eli Collins made changes -
          Fix Version/s 3.0.0 [ 12320356 ]
          Affects Version/s 2.0.0 [ 12320353 ]
          Affects Version/s 3.0.0 [ 12320356 ]
          Target Version/s 3.0.0 [ 12320356 ] 2.0.0 [ 12320353 ]
          Priority Minor [ 4 ] Major [ 3 ]
          Component/s data-node [ 12312927 ]
          amith made changes -
          Attachment HDFS-3194_2.patch [ 12529924 ]
          amith made changes -
          Attachment HDFS-3194_4.patch [ 12529934 ]
          amith made changes -
          Attachment HDFS-3194_6.patch [ 12530162 ]
          Eli Collins made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Eli Collins made changes -
          Summary Continuous block scanning at DN side DataNode block scanner is running too frequently
          amith made changes -
          Attachment HDFS-3194_7.patch [ 12532892 ]
          amith made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suresh Srinivas made changes -
          Link This issue is related to HDFS-1655 [ HDFS-1655 ]
          Uma Maheswara Rao G made changes -
          Link This issue is related to HDFS-3803 [ HDFS-3803 ]
          Eli Collins made changes -
          Assignee amith [ amithdk ] Andy Isaacson [ adi2 ]
          Andy Isaacson made changes -
          Attachment hdfs-3194-1.txt [ 12541132 ]
          Eli Collins made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Target Version/s 2.0.0-alpha [ 12320353 ]
          Fix Version/s 2.2.0-alpha [ 12322472 ]
          Resolution Fixed [ 1 ]
          Uma Maheswara Rao G made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Andy Isaacson made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Andy Isaacson made changes -
          Link This issue relates to HDFS-3828 [ HDFS-3828 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Andy Isaacson
              Reporter:
              suja s
            • Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development