Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1054

Remove unnecessary sleep after failure in nextBlockOutputStream

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.3, 0.20-append, 0.21.0, 0.22.0
    • 0.20-append, 0.20.205.0, 0.21.0
    • hdfs-client
    • None

    Description

      If DFSOutputStream fails to create a pipeline, it currently sleeps 6 seconds before retrying. I don't see a great reason to wait at all, much less 6 seconds (especially now that HDFS-630 ensures that a retry won't go back to the bad node). We should at least make it configurable, and perhaps something like backoff makes some sense.

      Attachments

        1. hdfs-1054.txt
          2 kB
          Todd Lipcon
        2. hdfs-1054.txt
          2 kB
          Todd Lipcon
        3. hdfs-1054-0.20-append.txt
          1 kB
          Todd Lipcon
        4. HDFS-1054.20-security.1.patch
          1 kB
          Jitendra Nath Pandey

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment