Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9188

Make block corruption related tests FsDataset-agnostic.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: test
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Currently, HDFS does block corruption tests by directly accessing the files stored on the storage directories, which assumes FsDatasetImpl is the dataset implementation. However, with works like OZone (HDFS-7240) and HDFS-8679, there will be different FsDataset implementations.

      So we need a general way to run whitebox tests like corrupting blocks and crc files.

        Attachments

        1. HDFS-9188.000.patch
          33 kB
          Lei (Eddy) Xu
        2. HDFS-9188.001.patch
          33 kB
          Lei (Eddy) Xu
        3. HDFS-9188.002.patch
          33 kB
          Lei (Eddy) Xu
        4. HDFS-9188.003.patch
          34 kB
          Lei (Eddy) Xu
        5. HDFS-9188.004.patch
          40 kB
          Lei (Eddy) Xu
        6. HDFS-9188.005.patch
          41 kB
          Lei (Eddy) Xu
        7. HDFS-9188.006.patch
          39 kB
          Lei (Eddy) Xu

          Issue Links

            Activity

              People

              • Assignee:
                eddyxu Lei (Eddy) Xu
                Reporter:
                eddyxu Lei (Eddy) Xu
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: