Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4867

metaSave NPEs when there are invalid blocks in repl queue.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.7, 2.0.4-alpha, 0.23.8
    • Fix Version/s: 2.1.0-beta, 0.23.9
    • Component/s: namenode
    • Labels:
      None

      Description

      Since metaSave cannot get the inode holding a orphaned/invalid block, it NPEs and stops generating further report. Normally ReplicationMonitor removes them quickly, but if the queue is huge, it takes very long time. Also in safe mode, they stay.

        Attachments

        1. testMetaSave.log
          6 kB
          Konstantin Shvachko
        2. HDFS-4867.trunk.patch
          4 kB
          Plamen Jeliazkov
        3. HDFS-4867.trunk.patch
          5 kB
          Plamen Jeliazkov
        4. HDFS-4867.trunk.patch
          6 kB
          Ravi Prakash
        5. HDFS-4867.trunk.patch
          2 kB
          Plamen Jeliazkov
        6. HDFS-4867.branch-2.patch
          1.0 kB
          Plamen Jeliazkov
        7. HDFS-4867.branch2.patch
          4 kB
          Plamen Jeliazkov
        8. HDFS-4867.branch2.patch
          4 kB
          Plamen Jeliazkov
        9. HDFS-4867.branch2.patch
          6 kB
          Ravi Prakash
        10. HDFS-4867.branch-0.23.patch
          5 kB
          Ravi Prakash
        11. HDFS-4867.branch-0.23.patch
          6 kB
          Ravi Prakash
        12. HDFS-4867.branch-0.23.patch
          2 kB
          Plamen Jeliazkov
        13. HDFS-4867.branch-0.23.patch
          3 kB
          Konstantin Shvachko

          Issue Links

            Activity

              People

              • Assignee:
                zero45 Plamen Jeliazkov
                Reporter:
                kihwal Kihwal Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: