Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1054

Remove unnecessary sleep after failure in nextBlockOutputStream

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.3, 0.20-append, 0.21.0, 0.22.0
    • Fix Version/s: 0.20-append, 0.20.205.0, 0.21.0
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      If DFSOutputStream fails to create a pipeline, it currently sleeps 6 seconds before retrying. I don't see a great reason to wait at all, much less 6 seconds (especially now that HDFS-630 ensures that a retry won't go back to the bad node). We should at least make it configurable, and perhaps something like backoff makes some sense.

        Attachments

        1. hdfs-1054-0.20-append.txt
          1 kB
          Todd Lipcon
        2. hdfs-1054.txt
          2 kB
          Todd Lipcon
        3. hdfs-1054.txt
          2 kB
          Todd Lipcon
        4. HDFS-1054.20-security.1.patch
          1 kB
          Jitendra Nath Pandey

          Activity

            People

            • Assignee:
              tlipcon Todd Lipcon
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: