Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3703 Decrease the datanode failure detection time
  3. HDFS-3912

Detecting and avoiding stale datanodes for writing

          Details

          • Type: Sub-task
          • Status: Closed
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 3.0.0-alpha1
          • Fix Version/s: 1.2.0, 2.0.3-alpha
          • Component/s: None
          • Labels:
            None
          • Hadoop Flags:
            Reviewed

            Description

            1. Make stale timeout adaptive to the number of nodes marked stale in the cluster.
            2. Consider having a separate configuration for write skipping the stale nodes.

              Attachments

              1. HDFS-3912.001.patch
                105 kB
                Jing Zhao
              2. HDFS-3912.002.patch
                65 kB
                Jing Zhao
              3. HDFS-3912.003.patch
                68 kB
                Jing Zhao
              4. HDFS-3912.004.patch
                64 kB
                Jing Zhao
              5. HDFS-3912.005.patch
                59 kB
                Jing Zhao
              6. HDFS-3912.006.patch
                57 kB
                Jing Zhao
              7. HDFS-3912.007.patch
                61 kB
                Jing Zhao
              8. HDFS-3912.008.patch
                61 kB
                Jing Zhao
              9. HDFS-3912.009.patch
                63 kB
                Jing Zhao
              10. HDFS-3912-branch-1.1-001.patch
                45 kB
                Jing Zhao
              11. HDFS-3912-010.patch
                63 kB
                Jing Zhao
              12. HDFS-3912-branch-1.patch
                46 kB
                Jing Zhao
              13. HDFS-3912.branch-1.patch
                44 kB
                Suresh Srinivas

                Issue Links

                is related to

                Bug - A problem which impairs or prevents the functions of the product. HDFS-4350 Make enabling of stale marking on read and write paths independent

                • Major - Major loss of function.
                • Closed

                Improvement - An improvement or enhancement to an existing feature or task. HDFS-3703 Decrease the datanode failure detection time

                • Major - Major loss of function.
                • Closed
                is required by

                Umbrella - An overarching type made of sub-tasks HBASE-5843 Improve HBase MTTR - Mean Time To Recover

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      jingzhao Jing Zhao
                      Reporter:
                      jingzhao Jing Zhao
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      15 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: