Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9188

Make block corruption related tests FsDataset-agnostic.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.7.1
    • 2.8.0, 3.0.0-alpha1
    • test
    • None
    • Reviewed

    Description

      Currently, HDFS does block corruption tests by directly accessing the files stored on the storage directories, which assumes FsDatasetImpl is the dataset implementation. However, with works like OZone (HDFS-7240) and HDFS-8679, there will be different FsDataset implementations.

      So we need a general way to run whitebox tests like corrupting blocks and crc files.

      Attachments

        1. HDFS-9188.006.patch
          39 kB
          Lei (Eddy) Xu
        2. HDFS-9188.005.patch
          41 kB
          Lei (Eddy) Xu
        3. HDFS-9188.004.patch
          40 kB
          Lei (Eddy) Xu
        4. HDFS-9188.003.patch
          34 kB
          Lei (Eddy) Xu
        5. HDFS-9188.002.patch
          33 kB
          Lei (Eddy) Xu
        6. HDFS-9188.001.patch
          33 kB
          Lei (Eddy) Xu
        7. HDFS-9188.000.patch
          33 kB
          Lei (Eddy) Xu

        Issue Links

          Activity

            People

              eddyxu Lei (Eddy) Xu
              eddyxu Lei (Eddy) Xu
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: