Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3703 Decrease the datanode failure detection time
  3. HDFS-3912

Detecting and avoiding stale datanodes for writing

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 1.2.0, 2.0.3-alpha
    • None
    • None
    • Reviewed

    Description

      1. Make stale timeout adaptive to the number of nodes marked stale in the cluster.
      2. Consider having a separate configuration for write skipping the stale nodes.

      Attachments

        1. HDFS-3912.001.patch
          105 kB
          Jing Zhao
        2. HDFS-3912.002.patch
          65 kB
          Jing Zhao
        3. HDFS-3912.003.patch
          68 kB
          Jing Zhao
        4. HDFS-3912.004.patch
          64 kB
          Jing Zhao
        5. HDFS-3912.005.patch
          59 kB
          Jing Zhao
        6. HDFS-3912.006.patch
          57 kB
          Jing Zhao
        7. HDFS-3912.007.patch
          61 kB
          Jing Zhao
        8. HDFS-3912.008.patch
          61 kB
          Jing Zhao
        9. HDFS-3912.009.patch
          63 kB
          Jing Zhao
        10. HDFS-3912.branch-1.patch
          44 kB
          Suresh Srinivas
        11. HDFS-3912-010.patch
          63 kB
          Jing Zhao
        12. HDFS-3912-branch-1.1-001.patch
          45 kB
          Jing Zhao
        13. HDFS-3912-branch-1.patch
          46 kB
          Jing Zhao

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-4350 Make enabling of stale marking on read and write paths independent

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-3703 Decrease the datanode failure detection time

        • Major - Major loss of function.
        • Closed
        is required by

        Umbrella - An overarching type made of sub-tasks HBASE-5843 Improve HBase MTTR - Mean Time To Recover

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jingzhao Jing Zhao Assign to me
            jingzhao Jing Zhao
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment