Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1054

Remove unnecessary sleep after failure in nextBlockOutputStream

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.3, 0.20-append, 0.21.0, 0.22.0
    • 0.20-append, 0.20.205.0, 0.21.0
    • hdfs-client
    • None

    Description

      If DFSOutputStream fails to create a pipeline, it currently sleeps 6 seconds before retrying. I don't see a great reason to wait at all, much less 6 seconds (especially now that HDFS-630 ensures that a retry won't go back to the bad node). We should at least make it configurable, and perhaps something like backoff makes some sense.

      Attachments

        1. HDFS-1054.20-security.1.patch
          1 kB
          Jitendra Nath Pandey
        2. hdfs-1054.txt
          2 kB
          Todd Lipcon
        3. hdfs-1054.txt
          2 kB
          Todd Lipcon
        4. hdfs-1054-0.20-append.txt
          1 kB
          Todd Lipcon

        Activity

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: