Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9188

Make block corruption related tests FsDataset-agnostic.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: test
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Currently, HDFS does block corruption tests by directly accessing the files stored on the storage directories, which assumes FsDatasetImpl is the dataset implementation. However, with works like OZone (HDFS-7240) and HDFS-8679, there will be different FsDataset implementations.

      So we need a general way to run whitebox tests like corrupting blocks and crc files.

        Attachments

        1. HDFS-9188.000.patch
          33 kB
          Lei (Eddy) Xu
        2. HDFS-9188.001.patch
          33 kB
          Lei (Eddy) Xu
        3. HDFS-9188.002.patch
          33 kB
          Lei (Eddy) Xu
        4. HDFS-9188.003.patch
          34 kB
          Lei (Eddy) Xu
        5. HDFS-9188.004.patch
          40 kB
          Lei (Eddy) Xu
        6. HDFS-9188.005.patch
          41 kB
          Lei (Eddy) Xu
        7. HDFS-9188.006.patch
          39 kB
          Lei (Eddy) Xu

          Issue Links

          is required by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9282 Make data directory count and storage raw capacity related tests FsDataset-agnostic

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

            Activity

              People

              • Assignee:
                eddyxu Lei (Eddy) Xu
                Reporter:
                eddyxu Lei (Eddy) Xu
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: