Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2703

New files under lease (before close) still shows up as MISSING files/blocks in fsck

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.15.3
    • 0.18.0
    • None
    • None
    • Incompatible change, Reviewed
    • Changed fsck to ignore files opened for writing. Introduced new option "-openforwrite" to explicitly show open files.

    Description

      On 0.15.3 which includes HADOOP-2540 ("Empty blocks make fsck report corrupt, even when it isn't") fix, we are still seeing fsck reporting missing blocks when they aren't. Basically, any unclosed small files under lease shows up as MISSING.

      Can we have an option in fsck to skip those files under lease?
      Or count those files/blocks separately?

      Attachments

        1. HADOOP-2703-1.patch
          11 kB
          Lohit Vijaya Renu
        2. HADOOP-2703-2.patch
          12 kB
          Lohit Vijaya Renu
        3. HADOOP-2703-3.patch
          14 kB
          Lohit Vijaya Renu
        4. HADOOP-2703-4.patch
          14 kB
          Lohit Vijaya Renu
        5. HADOOP-2703-5.patch
          14 kB
          Lohit Vijaya Renu

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            lohit Lohit Vijaya Renu
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment