Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11274

Datanode should only check the failed volume upon IO errors

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is a performance improvement that is possible after HDFS-11182. The goal is to trigger async volume check with throttling only on suspected volume upon datanode file IO errors.

        Attachments

        1. HDFS-11274.01.patch
          36 kB
          Xiaoyu Yao
        2. HDFS-11274.02.patch
          36 kB
          Xiaoyu Yao
        3. HDFS-11274.03.patch
          57 kB
          Xiaoyu Yao
        4. HDFS-11274.04.patch
          59 kB
          Xiaoyu Yao
        5. HDFS-11274.05.patch
          63 kB
          Xiaoyu Yao
        6. HDFS-11274.06.patch
          66 kB
          Xiaoyu Yao
        7. HDFS-11274-branch-2.01.patch
          76 kB
          Arpit Agarwal

          Activity

            People

            • Assignee:
              xyao Xiaoyu Yao
              Reporter:
              xyao Xiaoyu Yao
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: