Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1243

0.20 append: Replication tests in TestFileAppend4 should not expect immediate replication

    Details

    • Type: Test Test
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.20-append
    • Fix Version/s: 0.20-append
    • Component/s: test
    • Labels:
      None

      Description

      The replicationTest() cases in TestFileAppend4 currently assume that the file has both valid replicas immediately after completing the file. However, the datanodes may take some milliseconds to report the replica - we should only expect 1 replica (fs.replication.min) immediately after close, and we should allow up to a second or so before asserting that we reach replication 2.

      1. hdfs-1243.txt
        1 kB
        Todd Lipcon

        Issue Links

          Activity

          Hide
          Todd Lipcon added a comment -

          This patch got rid of the occasional spurious failures on my hudson.

          Show
          Todd Lipcon added a comment - This patch got rid of the occasional spurious failures on my hudson.
          Hide
          Nicolas Spiegelberg added a comment -

          the addition of artificialBlockReceivedDelay() in HDFS-1197 made this problem pop up very frequently

          Show
          Nicolas Spiegelberg added a comment - the addition of artificialBlockReceivedDelay() in HDFS-1197 made this problem pop up very frequently
          Hide
          Nicolas Spiegelberg added a comment -

          +1 was seeing the same problem in our daily builds and independently made a similar fix

          Show
          Nicolas Spiegelberg added a comment - +1 was seeing the same problem in our daily builds and independently made a similar fix
          Hide
          Allen Wittenauer added a comment -

          Probably stale.

          Show
          Allen Wittenauer added a comment - Probably stale.

            People

            • Assignee:
              Todd Lipcon
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development