Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12791

NameNode Fsck http Connection can timeout for directories with multiple levels

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.0
    • Component/s: tools
    • Labels:
      None

      Description

      Currently the http connections are flushed for every 100 files, however if there are multiple levels of directories in the namespace then flushing will be postponed till multiple directories levels have been traversed. This connection timeout can be avoided if both files and directories are considered for the flushing query.

          if (showprogress && (replRes.totalFiles + ecRes.totalFiles) % 100 == 0) {
            out.println();
            out.flush();
          }
      

        Attachments

        1. HDFS-12791.001.patch
          1 kB
          Mukul Kumar Singh

          Activity

            People

            • Assignee:
              msingh Mukul Kumar Singh
              Reporter:
              msingh Mukul Kumar Singh
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: