Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9188

Make block corruption related tests FsDataset-agnostic.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.7.1
    • 2.8.0, 3.0.0-alpha1
    • test
    • None
    • Reviewed

    Description

      Currently, HDFS does block corruption tests by directly accessing the files stored on the storage directories, which assumes FsDatasetImpl is the dataset implementation. However, with works like OZone (HDFS-7240) and HDFS-8679, there will be different FsDataset implementations.

      So we need a general way to run whitebox tests like corrupting blocks and crc files.

      Attachments

        1. HDFS-9188.000.patch
          33 kB
          Lei (Eddy) Xu
        2. HDFS-9188.001.patch
          33 kB
          Lei (Eddy) Xu
        3. HDFS-9188.002.patch
          33 kB
          Lei (Eddy) Xu
        4. HDFS-9188.003.patch
          34 kB
          Lei (Eddy) Xu
        5. HDFS-9188.004.patch
          40 kB
          Lei (Eddy) Xu
        6. HDFS-9188.005.patch
          41 kB
          Lei (Eddy) Xu
        7. HDFS-9188.006.patch
          39 kB
          Lei (Eddy) Xu

        Issue Links

          is required by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9282 Make data directory count and storage raw capacity related tests FsDataset-agnostic

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              eddyxu Lei (Eddy) Xu
              eddyxu Lei (Eddy) Xu
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: