Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13086

Add a field about exception type to BlockOpResponseProto

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.1.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Flags:
      Patch

      Description

      When user re-read a file in the way of short-circuit reads, it may come across unknown errors due to the reasons that the file has been appended after the first read which changes it's meta file, or the file has been moved away by the balancer.

      Such unknown errors will unnecessary disable short-circuit reads for 10 minutes. HDFS-12528 Make the expireAfterWrite of DomainSocketFactory$pathMap configurable to give user a choice of never disable the domain socket. 

      We can go a step further that add a field about exception type to BlockOpResponseProto, so that we can Ignore the acceptable FNFE and set a appropriate disable time to handle the unacceptable exceptions when different type of exception happens in the same cluster.

        Attachments

        1. HDFS-13086.001.patch
          12 kB
          LiXin Ge
        2. HDFS-13086.002.patch
          12 kB
          LiXin Ge

          Issue Links

            Activity

              People

              • Assignee:
                GeLiXin LiXin Ge
                Reporter:
                GeLiXin LiXin Ge
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: