Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9188

Make block corruption related tests FsDataset-agnostic.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: test
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Currently, HDFS does block corruption tests by directly accessing the files stored on the storage directories, which assumes FsDatasetImpl is the dataset implementation. However, with works like OZone (HDFS-7240) and HDFS-8679, there will be different FsDataset implementations.

      So we need a general way to run whitebox tests like corrupting blocks and crc files.

        Attachments

        1. HDFS-9188.006.patch
          39 kB
          Lei (Eddy) Xu
        2. HDFS-9188.005.patch
          41 kB
          Lei (Eddy) Xu
        3. HDFS-9188.004.patch
          40 kB
          Lei (Eddy) Xu
        4. HDFS-9188.003.patch
          34 kB
          Lei (Eddy) Xu
        5. HDFS-9188.002.patch
          33 kB
          Lei (Eddy) Xu
        6. HDFS-9188.001.patch
          33 kB
          Lei (Eddy) Xu
        7. HDFS-9188.000.patch
          33 kB
          Lei (Eddy) Xu

        Issue Links

        is required by

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-9282 Make data directory count and storage raw capacity related tests FsDataset-agnostic

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

          Activity
          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              eddyxu Lei (Eddy) Xu
              Reporter:
              eddyxu Lei (Eddy) Xu

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment