Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3504

Configurable retry in DFSClient

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0, 2.0.0-alpha
    • Fix Version/s: 1.1.0, 2.0.2-alpha
    • Component/s: hdfs-client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When NN maintenance is performed on a large cluster, jobs end up failing. This is particularly bad for long running jobs. The client retry policy could be made configurable so that jobs don't need to be restarted.

        Attachments

        1. h3504_20120611.patch
          59 kB
          Tsz-wo Sze
        2. h3504_20120611_b-1.0.patch
          43 kB
          Tsz-wo Sze
        3. h3504_20120608.patch
          23 kB
          Tsz-wo Sze
        4. h3504_20120607.patch
          10 kB
          Tsz-wo Sze

          Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. RATIS-736 Add a new RetryPolicy similar to MultipleLinearRandomRetry in HDFS

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                szetszwo Tsz-wo Sze
                Reporter:
                sseth Siddharth Seth
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: