Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13086

Add a field about exception type to BlockOpResponseProto

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 3.1.0
    • None
    • None
    • None
    • Patch

    Description

      When user re-read a file in the way of short-circuit reads, it may come across unknown errors due to the reasons that the file has been appended after the first read which changes it's meta file, or the file has been moved away by the balancer.

      Such unknown errors will unnecessary disable short-circuit reads for 10 minutes. HDFS-12528 Make the expireAfterWrite of DomainSocketFactory$pathMap configurable to give user a choice of never disable the domain socket. 

      We can go a step further that add a field about exception type to BlockOpResponseProto, so that we can Ignore the acceptable FNFE and set a appropriate disable time to handle the unacceptable exceptions when different type of exception happens in the same cluster.

      Attachments

        1. HDFS-13086.001.patch
          12 kB
          LiXin Ge
        2. HDFS-13086.002.patch
          12 kB
          LiXin Ge

        Issue Links

          Activity

            People

              GeLiXin LiXin Ge
              GeLiXin LiXin Ge
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: