Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1252

TestDFSConcurrentFileOperations broken in 0.20-appendj

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Test
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20-append
    • 0.20.205.0
    • test
    • None
    • Reviewed

    Description

      This test currently has several flaws:

      • It calls DN.updateBlock with a BlockInfo instance, which then causes java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.server.namenode.BlocksMap$BlockInfo.<init>() in the logs when the DN tries to send blockReceived for the block
      • It assumes that getBlockLocations returns an up-to-date length block after a sync, which is false. It happens to work because it calls getBlockLocations directly on the NN, and thus gets a direct reference to the block in the blockmap, which later gets updated

      This patch fixes this test to use the AppendTestUtil functions to intiiate recovery, and generally pass more reliably.

      Attachments

        1. HDFS-1252.20s.1.patch
          3 kB
          Suresh Srinivas
        2. HDFS-1252.20s.patch
          3 kB
          Suresh Srinivas
        3. hdfs-1252.txt
          5 kB
          Todd Lipcon

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment