Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4633

TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.2.0, 3.0.0-alpha1
    • 2.3.0
    • hdfs-client, test
    • None
    • Reviewed

    Description

      TestDFSClientExcludedNodes simulates failures of individual data nodes in the client's write pipeline and checks the client's ability to recover. HDFS-4246 added support for periodic "forgiveness" by caching the list of known bad data nodes with a periodic eviction. The test uses a 1 second cache expiration. This sometimes causes failed nodes to be forgiven too fast and violate the assumptions of the test.

      Attachments

        1. HDFS-4633.1.patch
          3 kB
          Chris Nauroth
        2. HDFS-4633.2.patch
          3 kB
          Chris Nauroth
        3. HDFS-4633.3.patch
          3 kB
          Chris Nauroth

        Issue Links

          is broken by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-4246 The exclude node list should be more forgiving, for each output stream

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-3602 Enhancements to HDFS for Windows Server and Windows Azure development and runtime environments

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              cnauroth Chris Nauroth
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: