Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1111

getCorruptFiles() should give some hint that the list is not complete

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.22.0
    • None
    • None
    • Reviewed

    Description

      If the list of corruptfiles returned by the namenode doesn't say anything if the number of corrupted files is larger than the call output limit (which means the list is not complete). There should be a way to hint incompleteness to clients.

      A simple hack would be to add an extra entry to the array returned with the value null. Clients could interpret this as a sign that there are other corrupt files in the system.

      We should also do some rephrasing of the fsck output to make it more confident when the list is not complete and less confident when the list is known to be incomplete.

      Attachments

        1. HADFS-1111.0.patch
          23 kB
          Rodrigo Schmidt
        2. HDFS-1111.trunk.1.patch
          55 kB
          Sriram Rao
        3. HDFS-1111.trunk.2.patch
          55 kB
          Sriram Rao
        4. HDFS-1111.trunk.2s.patch
          56 kB
          Konstantin Shvachko
        5. HDFS-1111.trunk.patch
          39 kB
          Sriram Rao
        6. HDFS-1111-y20.1.patch
          16 kB
          Sriram Rao
        7. HDFS-1111-y20.2.patch
          23 kB
          Sriram Rao

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sriramsrao Sriram Rao
            rschmidt Rodrigo Schmidt
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment