Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3703 Decrease the datanode failure detection time
  3. HDFS-3912

Detecting and avoiding stale datanodes for writing

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 1.2.0, 2.0.3-alpha
    • None
    • None
    • Reviewed

    Description

      1. Make stale timeout adaptive to the number of nodes marked stale in the cluster.
      2. Consider having a separate configuration for write skipping the stale nodes.

      Attachments

        1. HDFS-3912.001.patch
          105 kB
          Jing Zhao
        2. HDFS-3912.002.patch
          65 kB
          Jing Zhao
        3. HDFS-3912.003.patch
          68 kB
          Jing Zhao
        4. HDFS-3912.004.patch
          64 kB
          Jing Zhao
        5. HDFS-3912.005.patch
          59 kB
          Jing Zhao
        6. HDFS-3912.006.patch
          57 kB
          Jing Zhao
        7. HDFS-3912.007.patch
          61 kB
          Jing Zhao
        8. HDFS-3912.008.patch
          61 kB
          Jing Zhao
        9. HDFS-3912.009.patch
          63 kB
          Jing Zhao
        10. HDFS-3912-branch-1.1-001.patch
          45 kB
          Jing Zhao
        11. HDFS-3912-010.patch
          63 kB
          Jing Zhao
        12. HDFS-3912-branch-1.patch
          46 kB
          Jing Zhao
        13. HDFS-3912.branch-1.patch
          44 kB
          Suresh Srinivas

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4350 Make enabling of stale marking on read and write paths independent

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-3703 Decrease the datanode failure detection time

          • Major - Major loss of function.
          • Closed
          is required by

          Umbrella - An overarching type made of sub-tasks HBASE-5843 Improve HBase MTTR - Mean Time To Recover

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jingzhao Jing Zhao
              jingzhao Jing Zhao
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: