Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1629

Block CRC Unit Tests: upgrade test

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Test
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.14.0
    • 0.14.0
    • None
    • None

    Description

      HADOOP-1286 introduced a distributed upgrade framework. 1 or more unit tests should be developed that start with a zipped up Hadoop 0.12 file system (that is included in Hadoop's src/test directory under version controlled) and attempts to upgrade it to the current version of Hadoop (ie the version that the tests are running against). The zipped up file system should include some "interesting" files, such as:

      • zero length files
      • file with replication set higher than number of datanodes
      • file with no .crc file
      • file with corrupt .crc file
      • file with multiple blocks (will need to set dfs.block.size to a small value)
      • file with multiple checksum blocks
      • empty directory
      • all of the above again but with a different io.bytes.per.checksum setting

      The class that generates the zipped up file system should also be included in this patch.

      Attachments

        1. HADOOP-1629.patch
          8 kB
          Raghu Angadi
        2. hadoop-12-dfs-dir.tgz
          136 kB
          Raghu Angadi
        3. HADOOP-1629.patch
          14 kB
          Raghu Angadi
        4. HADOOP-1629.patch
          15 kB
          Raghu Angadi
        5. HADOOP-1629-trunk.patch
          15 kB
          Raghu Angadi

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rangadi Raghu Angadi Assign to me
            nidaley Nigel Daley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment