Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1629

Block CRC Unit Tests: upgrade test

    XMLWordPrintableJSON

Details

    • Test
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.14.0
    • 0.14.0
    • None
    • None

    Description

      HADOOP-1286 introduced a distributed upgrade framework. 1 or more unit tests should be developed that start with a zipped up Hadoop 0.12 file system (that is included in Hadoop's src/test directory under version controlled) and attempts to upgrade it to the current version of Hadoop (ie the version that the tests are running against). The zipped up file system should include some "interesting" files, such as:

      • zero length files
      • file with replication set higher than number of datanodes
      • file with no .crc file
      • file with corrupt .crc file
      • file with multiple blocks (will need to set dfs.block.size to a small value)
      • file with multiple checksum blocks
      • empty directory
      • all of the above again but with a different io.bytes.per.checksum setting

      The class that generates the zipped up file system should also be included in this patch.

      Attachments

        1. hadoop-12-dfs-dir.tgz
          136 kB
          Raghu Angadi
        2. HADOOP-1629.patch
          15 kB
          Raghu Angadi
        3. HADOOP-1629.patch
          14 kB
          Raghu Angadi
        4. HADOOP-1629.patch
          8 kB
          Raghu Angadi
        5. HADOOP-1629-trunk.patch
          15 kB
          Raghu Angadi

        Activity

          People

            rangadi Raghu Angadi
            nidaley Nigel Daley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: