Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3703 Decrease the datanode failure detection time
  3. HDFS-3912

Detecting and avoiding stale datanodes for writing

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 1.2.0, 2.0.3-alpha
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      1. Make stale timeout adaptive to the number of nodes marked stale in the cluster.
      2. Consider having a separate configuration for write skipping the stale nodes.

        Attachments

        1. HDFS-3912.001.patch
          105 kB
          Jing Zhao
        2. HDFS-3912.002.patch
          65 kB
          Jing Zhao
        3. HDFS-3912.003.patch
          68 kB
          Jing Zhao
        4. HDFS-3912.004.patch
          64 kB
          Jing Zhao
        5. HDFS-3912.005.patch
          59 kB
          Jing Zhao
        6. HDFS-3912.006.patch
          57 kB
          Jing Zhao
        7. HDFS-3912.007.patch
          61 kB
          Jing Zhao
        8. HDFS-3912.008.patch
          61 kB
          Jing Zhao
        9. HDFS-3912.009.patch
          63 kB
          Jing Zhao
        10. HDFS-3912-branch-1.1-001.patch
          45 kB
          Jing Zhao
        11. HDFS-3912-010.patch
          63 kB
          Jing Zhao
        12. HDFS-3912-branch-1.patch
          46 kB
          Jing Zhao
        13. HDFS-3912.branch-1.patch
          44 kB
          Suresh Srinivas

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4350 Make enabling of stale marking on read and write paths independent

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-3703 Decrease the datanode failure detection time

          • Major - Major loss of function.
          • Closed
          is required by

          Umbrella - An overarching type made of sub-tasks HBASE-5843 Improve HBase MTTR - Mean Time To Recover

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                jingzhao Jing Zhao
                Reporter:
                jingzhao Jing Zhao
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: